-- Logs begin at Thu 2022-06-23 12:55:23 UTC, end at Thu 2022-06-23 14:02:22 UTC. -- Jun 23 13:32:24.138136 dv-cinder-815582-10-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 13:32:24.149193 dv-cinder-815582-10-smb devstack@keystone.service[86756]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 13:32:24.151220 dv-cinder-815582-10-smb devstack@keystone.service[86756]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 13:32:24 2022] *** Jun 23 13:32:24.151220 dv-cinder-815582-10-smb devstack@keystone.service[86756]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 13:32:24.151220 dv-cinder-815582-10-smb devstack@keystone.service[86756]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 13:32:24.151220 dv-cinder-815582-10-smb devstack@keystone.service[86756]: nodename: dv-cinder-815582-10-smb Jun 23 13:32:24.151220 dv-cinder-815582-10-smb devstack@keystone.service[86756]: machine: x86_64 Jun 23 13:32:24.151220 dv-cinder-815582-10-smb devstack@keystone.service[86756]: clock source: unix Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: pcre jit disabled Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: detected number of CPU cores: 4 Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: current working directory: / Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: detected binary path: /usr/bin/uwsgi-core Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: your processes number limit is 47680 Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: your memory page size is 4096 bytes Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: detected max file descriptor number: 2048 Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: lock engine: pthread robust mutexes Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: thunder lock: enabled Jun 23 13:32:24.151581 dv-cinder-815582-10-smb devstack@keystone.service[86756]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 13:32:24.152056 dv-cinder-815582-10-smb devstack@keystone.service[86756]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 13:32:24.194760 dv-cinder-815582-10-smb devstack@keystone.service[86756]: Python main interpreter initialized at 0x55ba698339c0 Jun 23 13:32:24.194760 dv-cinder-815582-10-smb devstack@keystone.service[86756]: python threads support enabled Jun 23 13:32:24.194760 dv-cinder-815582-10-smb devstack@keystone.service[86756]: your server socket listen backlog is limited to 100 connections Jun 23 13:32:24.194760 dv-cinder-815582-10-smb devstack@keystone.service[86756]: your mercy for graceful operations on workers is 90 seconds Jun 23 13:32:24.195115 dv-cinder-815582-10-smb devstack@keystone.service[86756]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 13:32:24.195190 dv-cinder-815582-10-smb devstack@keystone.service[86756]: *** Operational MODE: preforking *** Jun 23 13:32:24.195486 dv-cinder-815582-10-smb devstack@keystone.service[86756]: *** uWSGI is running in multiple interpreter mode *** Jun 23 13:32:24.195486 dv-cinder-815582-10-smb devstack@keystone.service[86756]: spawned uWSGI master process (pid: 86756) Jun 23 13:32:24.195672 dv-cinder-815582-10-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 13:32:24.196779 dv-cinder-815582-10-smb devstack@keystone.service[86756]: spawned uWSGI worker 1 (pid: 86768, cores: 1) Jun 23 13:32:24.196779 dv-cinder-815582-10-smb devstack@keystone.service[86756]: spawned uWSGI worker 2 (pid: 86769, cores: 1) Jun 23 13:32:24.196779 dv-cinder-815582-10-smb devstack@keystone.service[86756]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 13:32:29.605645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:32:29.605645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: from cryptography.utils import int_from_bytes Jun 23 13:32:29.606386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:32:29.606386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: from cryptography.utils import int_from_bytes Jun 23 13:32:29.606508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:32:29.606508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: from cryptography.utils import int_from_bytes Jun 23 13:32:29.606508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:32:29.606508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: from cryptography.utils import int_from_bytes Jun 23 13:32:29.654887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:32:29.655080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:32:29.655269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:32:29.655372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] command line args: [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:32:29.655455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:32:29.655567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:32:29.655653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] command line args: [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:32:29.655749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ================================================================================ {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:32:29.655912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:32:29.655989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] admin_token = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.656096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ================================================================================ {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:32:29.656239 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] config_dir = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.656354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] admin_token = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.656437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.656598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] config_source = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.656679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] config_dir = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.656791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] debug = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.656926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] config_source = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] debug = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.657953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] list_limit = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] log_config_append = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] list_limit = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] log_config_append = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] log_dir = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.658937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] log_file = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] log_dir = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] log_file = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.659924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.660984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.661915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.662025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.662143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.662255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.662379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.662523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.662765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.662951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] publish_errors = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] publish_errors = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.663803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664385 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] standard_threads = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] standard_threads = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.664899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] use_journal = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] use_json = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] use_journal = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665833 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] use_stderr = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.665957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] use_json = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.666070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] use_syslog = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.666189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] use_stderr = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.666303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.666414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] use_syslog = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.666414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:32:29.666633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.666633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.666855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.666855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.667897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.668958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.669071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.669182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.669294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.669405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.669517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.670373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.670496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.670609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.670728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.670848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.670961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.671153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.671328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.671444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.671556 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.671684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.671801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.671921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.672959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.673889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.674938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.675912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.676912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.677937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.678872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.679954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.680968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.681899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.682938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.683883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.684887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.685005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.685126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.685231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.686229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.686352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.686475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.686596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.686718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.686839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.686959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.687905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.688884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.689948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.690877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.691990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] auth.external = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.692942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] auth.external = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.693173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.693173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.693416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.693591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] auth.password = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.693715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.693833 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] auth.token = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.693947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] auth.password = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] auth.token = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.694994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] credential.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.695937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] credential.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.696999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.697935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.698995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.699980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.700191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.700311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.700425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.700538 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.700652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.700766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.700940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.701993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.702913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.703945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.704990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.705899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.706887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.707976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708319 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.708898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.709935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.710987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.711931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.712979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713206 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.713899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.714955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715441 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.715910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.716983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.717914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.718944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.719895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.720933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.721975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.722893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.723951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.724986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] role.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] role.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.725988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] role.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] role.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.726927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.727970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728437 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.728901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.729824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.730977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.731951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.732065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.732829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.732943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.733980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.734959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.735907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.736951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.737890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.connection = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.738956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.connection = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.739958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.740941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.741863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:32:29.742770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:32:29.742770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:32:29.770235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.770466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.770565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.770693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.771035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.771035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.779704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.780054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.807794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.807927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.808023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.808144 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.950065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.950265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.998904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.999086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.999494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:29.999734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.062811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.063938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.064029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.064186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.088750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.088984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.089914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.090040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.090124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.090271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.101033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.101340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.113760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.114943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.115073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86769) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.115153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.115319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86768) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 13:32:30.132884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.133096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:32:30.133426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.133508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.133623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:32:30.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:32:30.133891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.133971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.134150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 13:32:30.134231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.134403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.134484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.134657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.134738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.134915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.135172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.146327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.146603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.146872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.146951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.147147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.147255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.147445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.147728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.155457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.156049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.158715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.158994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.159299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.159380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.159583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.159664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.159864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.159947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.160997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.161186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.161273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.161447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.161527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.161715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.161982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.188918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.189380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.190516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.190794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.190991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.191295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.196037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.196425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.196547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.196706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.196938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.197223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.203974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.204256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.204544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.204830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.208724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.209010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.209291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.209371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.209573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.209665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.209847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.209927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.210119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.210198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.210385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.210465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.210651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.210731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.210913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.211179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.229153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.229428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.229825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.230103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.234485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.235289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.238110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.238504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.238905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.239335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.243516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.244362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.247090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.248528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.251396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.251655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.251938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.252207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.252288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.252480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.252568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.252756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.252836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.253052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.253329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.253605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.271985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.272267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.272533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.272803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.272921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.273205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.273479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.273751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.280671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.281636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.282349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.282637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.283365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.283645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.285830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.286109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.286389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.286667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.286845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.286953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.287123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.287426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.287703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.287979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.300632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.300913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.301191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.301469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.301754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.302036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.302328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.302610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.302951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.303273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.303581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.304135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.304430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.304724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.321892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.323064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.325159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.326394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.328477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.329705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.330196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.331465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.331848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.332125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.332404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.333098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.333379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.333659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.339642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.341073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.341234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.342718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.344485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.344776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.345163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.345444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.345959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.346258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.346647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.346935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.354459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.354746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.355024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.356060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.356350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.356629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.363404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86769) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.363678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.363951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.364219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.364485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.364855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.365008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86768) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 13:32:30.365139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.365290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.365415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.365571 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.365693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.365848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.365962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.366120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.366233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.366498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.366588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.366756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.366839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.367032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86769) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.367113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.367348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.367623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.367896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.368167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.368433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.368707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86768) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 13:32:30.405660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba698339c0 pid: 86769 (default app) Jun 23 13:32:30.406977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba698339c0 pid: 86768 (default app) Jun 23 13:32:30.409027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca0bb-7f86-4064-9903-a0dc1588d7f1 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:30.409330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca0bb-7f86-4064-9903-a0dc1588d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:30.409610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca0bb-7f86-4064-9903-a0dc1588d7f1 None None] PATH_INFO: `/v3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:30.413769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Thu Jun 23 13:32:30 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:38.124039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b09526-68f9-4f62-ae80-75e972d4fbc4 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:38.124618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b09526-68f9-4f62-ae80-75e972d4fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:38.124618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b09526-68f9-4f62-ae80-75e972d4fbc4 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:38.128892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:38.134651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:38.135024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:38.139435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:38.204929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: INFO dbcounter [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] Registered counter for database keystone Jun 23 13:32:38.226322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG oslo_db.sqlalchemy.engines [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:32:38.233257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writer thread running {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:32:38.409651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG passlib.handlers.bcrypt [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86769) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 13:32:38.409991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG passlib.handlers.bcrypt [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86769) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 13:32:38.464106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:38.465698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:38.586134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 23 13:32:38.756993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b09526-68f9-4f62-ae80-75e972d4fbc4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:38.826704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: INFO dbcounter [None req-93b09526-68f9-4f62-ae80-75e972d4fbc4 None None] Registered counter for database keystone Jun 23 13:32:38.845489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG oslo_db.sqlalchemy.engines [None req-93b09526-68f9-4f62-ae80-75e972d4fbc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:32:38.851522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writer thread running {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:32:38.968555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b09526-68f9-4f62-ae80-75e972d4fbc4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:38.972751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5dfe-94de-4276-9638-bb53c9838f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:38.973403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5dfe-94de-4276-9638-bb53c9838f56 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:38.973688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5dfe-94de-4276-9638-bb53c9838f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:38.973965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5dfe-94de-4276-9638-bb53c9838f56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:38.981967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac5dfe-94de-4276-9638-bb53c9838f56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:39.033745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6aac5dfe-94de-4276-9638-bb53c9838f56 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 13:32:39.034033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac5dfe-94de-4276-9638-bb53c9838f56 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:39.043285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Jun 23 13:32:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 13:32:39.049140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:39.064223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f776cd-4fda-4200-89a8-1a1e12f54523 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:39.069472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adabf82-0b57-48fa-bba2-dd70c3374db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:39.070591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adabf82-0b57-48fa-bba2-dd70c3374db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:39.070883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adabf82-0b57-48fa-bba2-dd70c3374db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:39.071163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adabf82-0b57-48fa-bba2-dd70c3374db6 admin admin] PATH_INFO: `/v3/projects/4822884e35e54aa6816f97330f3285a9` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:39.075292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adabf82-0b57-48fa-bba2-dd70c3374db6 admin admin] RBAC: Authorizing `identity:get_project(project_id=4822884e35e54aa6816f97330f3285a9)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:39.125626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3adabf82-0b57-48fa-bba2-dd70c3374db6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 13:32:39.125974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adabf82-0b57-48fa-bba2-dd70c3374db6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:39.130515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Jun 23 13:32:39 2022] GET /identity/v3/projects/4822884e35e54aa6816f97330f3285a9 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:41.116318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853f06-6bdd-43a7-9b09-563621f00156 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.116851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853f06-6bdd-43a7-9b09-563621f00156 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.116942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853f06-6bdd-43a7-9b09-563621f00156 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.120996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:32:41.126358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4da93-6726-413b-8e19-bece7f603c2f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.126785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4da93-6726-413b-8e19-bece7f603c2f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.126912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4da93-6726-413b-8e19-bece7f603c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.145396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-34e4da93-6726-413b-8e19-bece7f603c2f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:41.146891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-34e4da93-6726-413b-8e19-bece7f603c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:41.155071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 13:32:41.177376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd853f06-6bdd-43a7-9b09-563621f00156 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:41.189430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd853f06-6bdd-43a7-9b09-563621f00156 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:41.193621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2056b9-7147-4ee7-985c-d8abbce3d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:41.194241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2056b9-7147-4ee7-985c-d8abbce3d422 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.194529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2056b9-7147-4ee7-985c-d8abbce3d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.194812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2056b9-7147-4ee7-985c-d8abbce3d422 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.202474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2056b9-7147-4ee7-985c-d8abbce3d422 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:41.204281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2056b9-7147-4ee7-985c-d8abbce3d422 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:41.212872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Jun 23 13:32:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:32:41.218447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4da93-6726-413b-8e19-bece7f603c2f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:41.227130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4da93-6726-413b-8e19-bece7f603c2f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:41.231427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8343-5f94-4109-b7d8-6a53b99227ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:41.232895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8343-5f94-4109-b7d8-6a53b99227ad admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:41.233178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8343-5f94-4109-b7d8-6a53b99227ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:41.233457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8343-5f94-4109-b7d8-6a53b99227ad admin admin] PATH_INFO: `/v3/users/313ef37cfa214544815014c4f759284a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:41.234817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8343-5f94-4109-b7d8-6a53b99227ad admin admin] RBAC: Authorizing `identity:get_user(user_id=313ef37cfa214544815014c4f759284a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:41.236662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8343-5f94-4109-b7d8-6a53b99227ad admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:41.238189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Jun 23 13:32:41 2022] GET /identity/v3/users/313ef37cfa214544815014c4f759284a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:43.340721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a857-ff62-45a1-af28-4c89cc01de59 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.341276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a857-ff62-45a1-af28-4c89cc01de59 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.341276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a857-ff62-45a1-af28-4c89cc01de59 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.343101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:32:43.348350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518585e-441f-4eac-b338-d364a63b6dcf None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.348781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518585e-441f-4eac-b338-d364a63b6dcf None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.348925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518585e-441f-4eac-b338-d364a63b6dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.365837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9518585e-441f-4eac-b338-d364a63b6dcf None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:43.367019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9518585e-441f-4eac-b338-d364a63b6dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:43.373241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99e39-d51a-46d7-b0c8-0692e6dfdd47 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.373535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99e39-d51a-46d7-b0c8-0692e6dfdd47 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.373819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99e39-d51a-46d7-b0c8-0692e6dfdd47 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.375630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:32:43.380525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.380817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.381101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.421311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG passlib.handlers.bcrypt [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86768) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 13:32:43.421732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG passlib.handlers.bcrypt [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86768) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 13:32:43.450181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:43.467926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:43.469538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:43.473347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518585e-441f-4eac-b338-d364a63b6dcf None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:43.498822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:43.569495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:32:43.578676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518585e-441f-4eac-b338-d364a63b6dcf None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:43.590990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:43.612605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:43.613408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.613704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.613987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.625130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:32:43.636257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:43.637151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:32:43.637976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:32:43.643929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:43.691630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec6ac-5f94-4280-8783-66c1161091b9 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:43.693916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:43.728280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:43.729513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:43.730549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.730924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.731301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.748333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680821-81e3-4938-a328-de289b5ced76 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:43.780996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:43.781661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.781950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.782229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.782983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:43.783338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:43.784750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:43.796694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:43.798716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:43.800284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:43.802099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:43.897956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:32:43.900078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e149a-81a0-48d5-b3f4-3cf2249f0727 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:43.903499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:43.906901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:43.933852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:43.934720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:43.935002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:43.935308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] PATH_INFO: `/v3/users/313ef37cfa214544815014c4f759284a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:43.936495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] RBAC: Authorizing `identity:get_user(user_id=313ef37cfa214544815014c4f759284a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:43.937962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:43.939601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:32:43 2022] GET /identity/v3/users/313ef37cfa214544815014c4f759284a => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:43.944788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:43.958910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:44.004443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3540d03-dfee-4019-9742-bc92cd8ef433 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:44.037899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:44.038686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:44.038970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:44.039267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:44.044981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a48ab-2d47-4297-ab17-e98e695c29da None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:44.057364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:44.058854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:44.079644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:44.080441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:44.080757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:44.081041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:32:44.081933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:44.082863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:44.088372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:32:44.088372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:32:44.088372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:32:44.088372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:32:44.088595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:44.088669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:32:44.088738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:44.088738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:44.090703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:44.090831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:44.145582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:44.170812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:44.189238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fe3f0-a15b-49bb-bdba-c61d215841f2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:44.191389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d61680-50e4-4794-a69e-7fd9c8763c17 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:44.222071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283616b-0880-479c-be60-8a492e6e5a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:44.222730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283616b-0880-479c-be60-8a492e6e5a8d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:44.223019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283616b-0880-479c-be60-8a492e6e5a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:44.223329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283616b-0880-479c-be60-8a492e6e5a8d None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:44.224055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283616b-0880-479c-be60-8a492e6e5a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:44.224368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283616b-0880-479c-be60-8a492e6e5a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:44.224745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a30721-b128-4db9-9b87-9672a9e74356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:44.225400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30721-b128-4db9-9b87-9672a9e74356 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:44.225692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30721-b128-4db9-9b87-9672a9e74356 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:44.225774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283616b-0880-479c-be60-8a492e6e5a8d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:44.225976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30721-b128-4db9-9b87-9672a9e74356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:44.226809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30721-b128-4db9-9b87-9672a9e74356 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.domain.id=default, user.id=313ef37cfa214544815014c4f759284a) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:44.227126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30721-b128-4db9-9b87-9672a9e74356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:44.228592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a30721-b128-4db9-9b87-9672a9e74356 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:44.235220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Jun 23 13:32:44 2022] GET /identity/v3/role_assignments?user.id=313ef37cfa214544815014c4f759284a&scope.domain.id=default&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:44.243075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:46.468056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbaae2-6b85-41d9-a88f-ca9b7ae72079 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:46.468557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbaae2-6b85-41d9-a88f-ca9b7ae72079 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:46.468629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbaae2-6b85-41d9-a88f-ca9b7ae72079 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:46.469987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:46.475501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400e430-63e3-4726-9451-81bdcc74c9ff None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:46.475898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400e430-63e3-4726-9451-81bdcc74c9ff None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:46.476094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400e430-63e3-4726-9451-81bdcc74c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:46.504227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f400e430-63e3-4726-9451-81bdcc74c9ff None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:46.505504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f400e430-63e3-4726-9451-81bdcc74c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:46.606434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:46.642481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbaae2-6b85-41d9-a88f-ca9b7ae72079 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:46.792138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f96b4-46b9-484c-9a6c-0e752d7bb3ee None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:46.792802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f96b4-46b9-484c-9a6c-0e752d7bb3ee None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:46.793307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f96b4-46b9-484c-9a6c-0e752d7bb3ee None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:46.793768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbaae2-6b85-41d9-a88f-ca9b7ae72079 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:46.795459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:46.800743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89597318-1225-4b6f-98da-d2b7c8e116da None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:46.801293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89597318-1225-4b6f-98da-d2b7c8e116da None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:46.801784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89597318-1225-4b6f-98da-d2b7c8e116da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:46.832234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-89597318-1225-4b6f-98da-d2b7c8e116da None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:46.833713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-89597318-1225-4b6f-98da-d2b7c8e116da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:46.845587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6275539-f6c2-4d7f-a4fd-36318a0bdaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:46.846398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6275539-f6c2-4d7f-a4fd-36318a0bdaed None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:46.846689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6275539-f6c2-4d7f-a4fd-36318a0bdaed None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:46.846974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6275539-f6c2-4d7f-a4fd-36318a0bdaed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:46.865917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6275539-f6c2-4d7f-a4fd-36318a0bdaed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-d6275539-f6c2-4d7f-a4fd-36318a0bdaed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:32:46.878066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:46.878938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:32:46.879732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 13/25] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:32:46.880542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32b5c-4c90-4497-a130-15ba0fe62a52 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:46.880973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32b5c-4c90-4497-a130-15ba0fe62a52 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:46.881394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32b5c-4c90-4497-a130-15ba0fe62a52 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:46.883414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 14/26] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:46.888789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b32b5c-4c90-4497-a130-15ba0fe62a52 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:46.895198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:46.931802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:46.976210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:46.978478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff749a2-3eee-4551-a3e6-762a4c9f6e1e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:46.979133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff749a2-3eee-4551-a3e6-762a4c9f6e1e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:46.981135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff749a2-3eee-4551-a3e6-762a4c9f6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.007466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1ff749a2-3eee-4551-a3e6-762a4c9f6e1e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:47.009095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1ff749a2-3eee-4551-a3e6-762a4c9f6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:47.056315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b32b5c-4c90-4497-a130-15ba0fe62a52 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:47.098768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 14/28] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:47.100128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019eb58-2cba-4d67-b7e4-b045ed416b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:47.100733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9a02-ab26-465b-a583-91adf2022ce5 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.101121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9a02-ab26-465b-a583-91adf2022ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.101295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019eb58-2cba-4d67-b7e4-b045ed416b3d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.101630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9a02-ab26-465b-a583-91adf2022ce5 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.101872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019eb58-2cba-4d67-b7e4-b045ed416b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.102285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019eb58-2cba-4d67-b7e4-b045ed416b3d None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.103165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:47.103334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019eb58-2cba-4d67-b7e4-b045ed416b3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:47.103774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019eb58-2cba-4d67-b7e4-b045ed416b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:47.104181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea9a02-ab26-465b-a583-91adf2022ce5 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.105540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019eb58-2cba-4d67-b7e4-b045ed416b3d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:47.114944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:47.116429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe1424-8d12-4779-b567-5d41162ec142 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.116942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe1424-8d12-4779-b567-5d41162ec142 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.117446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe1424-8d12-4779-b567-5d41162ec142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.134480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f2fe1424-8d12-4779-b567-5d41162ec142 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:47.136016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f2fe1424-8d12-4779-b567-5d41162ec142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:47.205778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:47.215145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:47.216890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe1424-8d12-4779-b567-5d41162ec142 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.236960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea9a02-ab26-465b-a583-91adf2022ce5 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:47.254088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:47.288415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:47.289556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.290321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.290780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.291739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:47.293763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:47.353119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe1424-8d12-4779-b567-5d41162ec142 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:47.392020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276921-eb14-4200-aea5-46d13420963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:47.392986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276921-eb14-4200-aea5-46d13420963f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.393390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276921-eb14-4200-aea5-46d13420963f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.393817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276921-eb14-4200-aea5-46d13420963f None admin] PATH_INFO: `/v3/users/313ef37cfa214544815014c4f759284a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.395088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85276921-eb14-4200-aea5-46d13420963f None admin] RBAC: Authorizing `identity:get_user(user_id=313ef37cfa214544815014c4f759284a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:47.396749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85276921-eb14-4200-aea5-46d13420963f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:47.398537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:32:47 2022] GET /identity/v3/users/313ef37cfa214544815014c4f759284a => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:47.399403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276921-eb14-4200-aea5-46d13420963f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.454526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 16/33] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 23 13:32:47 2022] POST /identity/v3/roles => generated 219 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:32:47.456210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.482834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:47.570775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276921-eb14-4200-aea5-46d13420963f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:47.641148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:47.641868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.642177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.643647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.657128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:47.658626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:47.665476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc6e9-17b8-4894-8979-b914831c841b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:32:47.685322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:47.686190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:47.686989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:32:47.686989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:32:47.686989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:32:47.686989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:32:47.686989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:32:47.687702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.710513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:47.711195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.711508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.711791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.712546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:47.714066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:47.739337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 17/35] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 23 13:32:47 2022] POST /identity/v3/roles => generated 225 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:32:47.741418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.778559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:47.823910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fade18-3be3-4de2-962e-2a4e106edb18 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:47.842507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:47.862535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:47.863444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.863789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.864076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.865293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:47.866798 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:47.868604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 19/36] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:47.873795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268a703-4192-499f-9ed5-41ff3d5a1579 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:47.874567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.914412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:47.915377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:47.915809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:47.916292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:47.917324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:47.917873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:47.919520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:47.946120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 18/37] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:47.953884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:47.998890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e63f1-8499-41a5-8347-e776fa0cfe51 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:48.041471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfca8db-14b7-4579-bf0b-b46b3ced19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:48.042628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca8db-14b7-4579-bf0b-b46b3ced19fb None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.043017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca8db-14b7-4579-bf0b-b46b3ced19fb None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.043431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca8db-14b7-4579-bf0b-b46b3ced19fb None admin] PATH_INFO: `/v3/domains/default/users/313ef37cfa214544815014c4f759284a/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.049428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfca8db-14b7-4579-bf0b-b46b3ced19fb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=313ef37cfa214544815014c4f759284a, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:48.051031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfca8db-14b7-4579-bf0b-b46b3ced19fb None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:48.102325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:48.122825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fa90-a5e5-4ead-a978-598a1656857a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:48.162427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d6c80-7e95-4856-a600-9d693a644f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:48.163485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6c80-7e95-4856-a600-9d693a644f2a None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.163994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6c80-7e95-4856-a600-9d693a644f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.164554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6c80-7e95-4856-a600-9d693a644f2a None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.167610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d6c80-7e95-4856-a600-9d693a644f2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:48.169410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d6c80-7e95-4856-a600-9d693a644f2a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:48.206042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1361 bytes} [Thu Jun 23 13:32:47 2022] PUT /identity/v3/domains/default/users/313ef37cfa214544815014c4f759284a/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:32:48.209697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:32:47 2022] POST /identity/v3/projects => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:32:48.262856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b41b-2c49-4a64-99ab-aa50ff06718b None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.263762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b41b-2c49-4a64-99ab-aa50ff06718b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.264120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b41b-2c49-4a64-99ab-aa50ff06718b None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.269213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 21/40] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:48.275321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999900ab-42a5-47c3-a945-b01d7c462551 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.275685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999900ab-42a5-47c3-a945-b01d7c462551 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.275884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999900ab-42a5-47c3-a945-b01d7c462551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.296753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-999900ab-42a5-47c3-a945-b01d7c462551 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:48.298353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-999900ab-42a5-47c3-a945-b01d7c462551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:48.316825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba1dd-cf47-40d2-aed4-4d36819b917e None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.318044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba1dd-cf47-40d2-aed4-4d36819b917e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.318826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba1dd-cf47-40d2-aed4-4d36819b917e None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.320897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 22/41] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:32:48.328142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af40c-79ce-4e84-a2c5-cdf37d8ffadb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.328759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af40c-79ce-4e84-a2c5-cdf37d8ffadb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.329238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af40c-79ce-4e84-a2c5-cdf37d8ffadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.354803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1a4af40c-79ce-4e84-a2c5-cdf37d8ffadb None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:48.357969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1a4af40c-79ce-4e84-a2c5-cdf37d8ffadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:48.395152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 20/42] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:48.421146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999900ab-42a5-47c3-a945-b01d7c462551 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:48.422451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:48.459481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 23/43] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:32:48.484139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af40c-79ce-4e84-a2c5-cdf37d8ffadb None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:48.510438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:48.551655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999900ab-42a5-47c3-a945-b01d7c462551 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:48.591087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:48.592329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.592620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.592902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.593686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:48.595129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:48.619251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 21/44] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 23 13:32:48 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:32:48.721845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af40c-79ce-4e84-a2c5-cdf37d8ffadb None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:48.766031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edee36-2388-4632-baf7-09c6390c5ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:48.766836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edee36-2388-4632-baf7-09c6390c5ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.767120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edee36-2388-4632-baf7-09c6390c5ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.767472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edee36-2388-4632-baf7-09c6390c5ff0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.768639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edee36-2388-4632-baf7-09c6390c5ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:48.770231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edee36-2388-4632-baf7-09c6390c5ff0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:48.771944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 24/45] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:48.777489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:48.882872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec04a5-e66b-4d96-91ea-91967001a8fe None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:48.908872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:48.918006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242158-1e5e-4d20-847e-c9075c1e71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:48.918680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242158-1e5e-4d20-847e-c9075c1e71d1 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:48.918971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242158-1e5e-4d20-847e-c9075c1e71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:48.919819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242158-1e5e-4d20-847e-c9075c1e71d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:48.920601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242158-1e5e-4d20-847e-c9075c1e71d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:48.922053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242158-1e5e-4d20-847e-c9075c1e71d1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:48.946735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:32:48 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:32:50.311647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd61ff7-8df0-475d-a471-993659f0768f None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:50.312160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd61ff7-8df0-475d-a471-993659f0768f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:50.312240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd61ff7-8df0-475d-a471-993659f0768f None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:50.313637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:50.318892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33e24-da01-4f53-86db-cc7524c8f7ba None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:50.319303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33e24-da01-4f53-86db-cc7524c8f7ba None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:50.319506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b33e24-da01-4f53-86db-cc7524c8f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:50.336212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-25b33e24-da01-4f53-86db-cc7524c8f7ba None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:50.337390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-25b33e24-da01-4f53-86db-cc7524c8f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:50.401954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:50.425253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd61ff7-8df0-475d-a471-993659f0768f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:50.469230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:50.526135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd61ff7-8df0-475d-a471-993659f0768f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:50.558841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:50.559660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:50.560522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:50.560803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:50.570615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:32:50.578202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:50.579034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:32:50.579924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 26/49] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:32:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:32:50.585068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b33e24-da01-4f53-86db-cc7524c8f7ba None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:50.680956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b33e24-da01-4f53-86db-cc7524c8f7ba None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:50.691486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:50.721147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:50.721821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:50.722107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:50.722384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:50.723137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:50.723476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:50.724860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:50.736248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 24/50] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:32:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:50.741648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:50.839299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78870239-dcd4-4aab-85c1-d1206783d2c7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:50.840726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:50.872231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb9795-7d33-4a45-8a91-6b88d2c216f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:50.873644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9795-7d33-4a45-8a91-6b88d2c216f0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:50.873934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9795-7d33-4a45-8a91-6b88d2c216f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:50.874214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb9795-7d33-4a45-8a91-6b88d2c216f0 None admin] PATH_INFO: `/v3/users/313ef37cfa214544815014c4f759284a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:50.875443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb9795-7d33-4a45-8a91-6b88d2c216f0 None admin] RBAC: Authorizing `identity:get_user(user_id=313ef37cfa214544815014c4f759284a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:50.876917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb9795-7d33-4a45-8a91-6b88d2c216f0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:50.878555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 27/51] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:32:50 2022] GET /identity/v3/users/313ef37cfa214544815014c4f759284a => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:50.883968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:51.019543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097bd7-5112-443a-bc01-f44ed6898e38 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:51.019827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097bd7-5112-443a-bc01-f44ed6898e38 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:51.020116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097bd7-5112-443a-bc01-f44ed6898e38 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:51.021704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 28/52] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:51.029607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060319-9904-4968-b9b3-95a19b0af1a9 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:51.030045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060319-9904-4968-b9b3-95a19b0af1a9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:51.030476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060319-9904-4968-b9b3-95a19b0af1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:51.055828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d3060319-9904-4968-b9b3-95a19b0af1a9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:51.057638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d3060319-9904-4968-b9b3-95a19b0af1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:51.086348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cece90-ad2e-4146-aecf-2b087700fe0e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:51.119724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:51.120449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:51.120735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:51.121018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:51.122199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:51.123724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:51.125343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 25/53] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:51.130878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:51.134226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 29/54] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:32:51.157875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060319-9904-4968-b9b3-95a19b0af1a9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:51.172075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:51.232515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482323-dab7-4e42-acfa-f73f737b0e52 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:51.254143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:51.257465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060319-9904-4968-b9b3-95a19b0af1a9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:51.265310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:51.266239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:51.266531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:51.266819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:51.267683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.domain.id=default, user.id=313ef37cfa214544815014c4f759284a) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:51.268008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:51.269445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:51.279290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 26/55] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Jun 23 13:32:51 2022] GET /identity/v3/role_assignments?user.id=313ef37cfa214544815014c4f759284a&scope.domain.id=default&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:51.293366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d7884-e067-4e22-835a-7ce768454640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:51.294191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d7884-e067-4e22-835a-7ce768454640 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:51.294481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d7884-e067-4e22-835a-7ce768454640 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:51.294763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d7884-e067-4e22-835a-7ce768454640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:51.296105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d7884-e067-4e22-835a-7ce768454640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:51.297625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d7884-e067-4e22-835a-7ce768454640 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:51.299366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 30/56] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:32:51.305330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:51.415745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae79bd8-c625-43de-8b55-aae71dccfb2f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:51.418068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:51.453497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4b1ab-1c59-40bc-a9ef-0ba0cafc94f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:51.454213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4b1ab-1c59-40bc-a9ef-0ba0cafc94f6 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:51.454667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4b1ab-1c59-40bc-a9ef-0ba0cafc94f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:51.454958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4b1ab-1c59-40bc-a9ef-0ba0cafc94f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:51.455715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4b1ab-1c59-40bc-a9ef-0ba0cafc94f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:51.457184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4b1ab-1c59-40bc-a9ef-0ba0cafc94f6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:51.483467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 27/57] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Jun 23 13:32:51 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:32:53.493249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f9ffe-8adb-43ef-932a-960fccc724b5 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:53.493637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f9ffe-8adb-43ef-932a-960fccc724b5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:53.493814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f9ffe-8adb-43ef-932a-960fccc724b5 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:53.495181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 31/58] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:53.500767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924085fd-cce3-48c2-a60a-7c12d361e462 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:53.501175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924085fd-cce3-48c2-a60a-7c12d361e462 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:53.501336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924085fd-cce3-48c2-a60a-7c12d361e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:53.517819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-924085fd-cce3-48c2-a60a-7c12d361e462 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:53.518994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-924085fd-cce3-48c2-a60a-7c12d361e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:53.582267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 28/59] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:53.605779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f9ffe-8adb-43ef-932a-960fccc724b5 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:53.706827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f9ffe-8adb-43ef-932a-960fccc724b5 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:53.741580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d20c4-9462-479a-836f-01e0918d56e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:53.742309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d20c4-9462-479a-836f-01e0918d56e1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:53.742600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d20c4-9462-479a-836f-01e0918d56e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:53.742886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d20c4-9462-479a-836f-01e0918d56e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:53.744092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d20c4-9462-479a-836f-01e0918d56e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:53.745565 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d20c4-9462-479a-836f-01e0918d56e1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:53.747184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 32/60] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:53.753151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924085fd-cce3-48c2-a60a-7c12d361e462 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:53.833529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:53.847969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924085fd-cce3-48c2-a60a-7c12d361e462 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:53.879973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e4b0e-0933-41c2-b2c9-656ed8c28a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:53.880643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4b0e-0933-41c2-b2c9-656ed8c28a97 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:53.880931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4b0e-0933-41c2-b2c9-656ed8c28a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:53.881212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4b0e-0933-41c2-b2c9-656ed8c28a97 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:53.881913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e4b0e-0933-41c2-b2c9-656ed8c28a97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:53.883392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e4b0e-0933-41c2-b2c9-656ed8c28a97 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:53.908516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 29/61] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:32:53 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:32:57.148601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca7b6-53e4-48ef-abf2-5a0a64241c26 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.149969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca7b6-53e4-48ef-abf2-5a0a64241c26 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.150685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca7b6-53e4-48ef-abf2-5a0a64241c26 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.153496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 33/62] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:57.159232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6fb7-9c29-4247-8c88-26fefd8952fa None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.160111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6fb7-9c29-4247-8c88-26fefd8952fa None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.160596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6fb7-9c29-4247-8c88-26fefd8952fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.184055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9690-1ca6-46c6-ac33-d8ccbaa55063 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.184676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9690-1ca6-46c6-ac33-d8ccbaa55063 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.185228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9690-1ca6-46c6-ac33-d8ccbaa55063 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.186809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 34/63] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:57.194423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-173d6fb7-9c29-4247-8c88-26fefd8952fa None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:57.195921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-173d6fb7-9c29-4247-8c88-26fefd8952fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:57.201423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e7110-404c-4bab-882e-f6ed873eb500 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.202070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e7110-404c-4bab-882e-f6ed873eb500 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.202563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e7110-404c-4bab-882e-f6ed873eb500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.225756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b79e7110-404c-4bab-882e-f6ed873eb500 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:57.227713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b79e7110-404c-4bab-882e-f6ed873eb500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:57.270169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:57.289918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 30/64] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:32:57.291395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652e99e-c2d1-47aa-baac-57ce70a08c99 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.291845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652e99e-c2d1-47aa-baac-57ce70a08c99 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.292360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652e99e-c2d1-47aa-baac-57ce70a08c99 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.293855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 31/65] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:57.304632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fb273-84f0-480f-a037-40e37855a7f1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.304917 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fb273-84f0-480f-a037-40e37855a7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.305346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fb273-84f0-480f-a037-40e37855a7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.324697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-126fb273-84f0-480f-a037-40e37855a7f1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:57.326414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-126fb273-84f0-480f-a037-40e37855a7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:57.330018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 35/66] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:32:57.339226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e7110-404c-4bab-882e-f6ed873eb500 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:57.406421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 32/67] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:57.407484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fb273-84f0-480f-a037-40e37855a7f1 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:57.415424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:57.491028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e7110-404c-4bab-882e-f6ed873eb500 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:57.514941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fb273-84f0-480f-a037-40e37855a7f1 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:57.529974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462dd69-78cd-49a0-a84f-7e902265fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:57.530801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462dd69-78cd-49a0-a84f-7e902265fc26 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.531095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462dd69-78cd-49a0-a84f-7e902265fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.531414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462dd69-78cd-49a0-a84f-7e902265fc26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.543251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462dd69-78cd-49a0-a84f-7e902265fc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-d462dd69-78cd-49a0-a84f-7e902265fc26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:32:57.551652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:57.552595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:32:57.553366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 36/68] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:32:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:32:57.554163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffa49-f505-485b-a537-a287453e3ea9 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.554595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffa49-f505-485b-a537-a287453e3ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.554886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ffa49-f505-485b-a537-a287453e3ea9 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.556353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 37/69] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:57.558683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:57.559528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.560480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.560730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ffa49-f505-485b-a537-a287453e3ea9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:57.561182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.574007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:32:57.584624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:57.585639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:32:57.586572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:32:57.588603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 33/70] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:32:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:32:57.590252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:57.594213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:57.664786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:57.671897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ffa49-f505-485b-a537-a287453e3ea9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:57.706489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3867fd7-798e-451a-8e68-66bcd718dd63 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:57.708284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4fda8-e920-472b-bc0f-096c1b4c8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:57.709080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4fda8-e920-472b-bc0f-096c1b4c8416 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.709364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4fda8-e920-472b-bc0f-096c1b4c8416 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.709643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4fda8-e920-472b-bc0f-096c1b4c8416 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.719655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4fda8-e920-472b-bc0f-096c1b4c8416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-19b4fda8-e920-472b-bc0f-096c1b4c8416 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:32:57.727282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:57.728123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:32:57.728865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 38/71] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:32:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:32:57.729695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741d901-8e8c-4828-8989-b093f93c0a67 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.729962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741d901-8e8c-4828-8989-b093f93c0a67 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.730170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741d901-8e8c-4828-8989-b093f93c0a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.744839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:57.745515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.745805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.745931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f741d901-8e8c-4828-8989-b093f93c0a67 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:57.746085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.746842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:57.747114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f741d901-8e8c-4828-8989-b093f93c0a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:57.747761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:57.749055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:57.757166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 34/72] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:32:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:57.758113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:57.815338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 39/73] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:57.816882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fff5b-cb7d-443a-8ab0-cd1966b1e6a0 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.817181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fff5b-cb7d-443a-8ab0-cd1966b1e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.817629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fff5b-cb7d-443a-8ab0-cd1966b1e6a0 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.819057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 40/74] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:32:57.820005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fff5b-cb7d-443a-8ab0-cd1966b1e6a0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:57.845325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:57.868060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d038-3187-4327-8e21-92a4300688fc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:57.891984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:57.903725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:57.904399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.904691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.904981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.905737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:57.906063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:57.907478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:57.916216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 35/75] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:32:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:57.916943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:57.929723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fff5b-cb7d-443a-8ab0-cd1966b1e6a0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:57.963037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e16e9-6b87-47b2-a326-99297d5405b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:57.963733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e16e9-6b87-47b2-a326-99297d5405b0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.964024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e16e9-6b87-47b2-a326-99297d5405b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.964307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e16e9-6b87-47b2-a326-99297d5405b0 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.965059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e16e9-6b87-47b2-a326-99297d5405b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:57.965375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e16e9-6b87-47b2-a326-99297d5405b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:57.966829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e16e9-6b87-47b2-a326-99297d5405b0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:57.974758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 41/76] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:32:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:57.980436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa550f-3ff0-4655-9089-29662ed71229 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:57.980735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa550f-3ff0-4655-9089-29662ed71229 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:57.981023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa550f-3ff0-4655-9089-29662ed71229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:57.997911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9aaa550f-3ff0-4655-9089-29662ed71229 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:32:57.999111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9aaa550f-3ff0-4655-9089-29662ed71229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:32:58.014779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971384e-b9d3-4ef1-9519-4332a569c1d9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.047523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.048386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.048677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.048956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.064320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.065754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.077611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 42/77] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:32:58.077611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa550f-3ff0-4655-9089-29662ed71229 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.077788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 36/78] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:32:57 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:58.077788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.079983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.125642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.168147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa550f-3ff0-4655-9089-29662ed71229 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.179459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384e805-f381-4dd4-bf7e-50222d2487c7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.202074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.202870 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.203159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.203497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.212864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.213329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:32:58.213750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.214045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.214337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.215601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.217090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.218723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 37/79] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:58.220580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:32:58.221299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:32:58.222142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:32:58.222921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 43/80] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:32:58.223590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.290674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.323081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416acf6-3ac2-42e9-9933-87378ce080ee None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.323521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b407cb-3b05-4386-9152-49df6aafadbd None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.335634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.357147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.357811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.358106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.358398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.358871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.359782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.360071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.360352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] PATH_INFO: `/v3/users/313ef37cfa214544815014c4f759284a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.361593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] RBAC: Authorizing `identity:get_user(user_id=313ef37cfa214544815014c4f759284a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.363067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.364783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 38/81] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/users/313ef37cfa214544815014c4f759284a => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:58.365633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.426609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.428056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.462726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7ed90-614f-44bc-8a32-73395bfc26f4 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.494566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.500565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.501365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.501654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.501936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.503109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.504618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.506247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 39/82] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:58.507003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.529869 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 44/83] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:58.530910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.561618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.613270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ba776-360e-4f1d-a6c9-4384ac3f4fde None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.625743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879ac58-979b-4e97-be71-c46c69f1c782 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.647112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.647799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.648096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.648389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.659117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.659814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.660106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.660384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.661127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:58.661435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.662834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.671662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 45/84] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:58.672433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.703487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.719378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.720868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.769266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.774332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190c70-8c70-462b-818a-b6e797e4e0ce None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.806365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.807008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.807396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.807678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.819346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 40/85] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:58.820381 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.876434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.878116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.907284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:58.917139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff43b0-ce96-4e67-9909-a98d3c2cf8c0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:58.952004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:58.952683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:58.952981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:58.953265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:58.954043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:58.955476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:58.974171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 41/86] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:32:58 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:32:58.974751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.979238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 46/87] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:58.979238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:58.993222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:59.098248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea66cc-fa0d-43b7-a652-c96e07f54f4f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.109996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1d6c-9d39-41f2-aa09-9fa0e06b1b22 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.128878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:59.138846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.139412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.141606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.141606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.144696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.144696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.146304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 47/88] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:59.147067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:59.155270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.157017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.157309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.157592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.158814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.160301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.162452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 42/89] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:32:58 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:59.163693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:59.250686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:59.279926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1afe6-6c86-4387-bc88-bd67acf24aa0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.288204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50967ba-559a-49c3-b6d9-4cec66597e0b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.324843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.325792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.326082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.326369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.327620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.329087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.330987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 48/90] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:32:59 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:59.331730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.331849 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:59.333021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.333482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.333929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.336575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.338211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.340159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 43/91] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:32:59 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:59.342171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:59.407855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:59.448733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061fedc-43aa-4a22-b9a0-fbf13bfe27bc None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.456976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b44b-f9bb-4c98-ac9f-afee0ae84d41 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.488788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.489717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.490178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.490678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.501823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.502509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.502874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.503244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.504714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] RBAC: Adding query filter params (role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=9cff92b0e6704fd3bfafffcd292f8e7d) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:59.505110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.507378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.515249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:32:59 2022] GET /identity/v3/role_assignments?user.id=9cff92b0e6704fd3bfafffcd292f8e7d&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:59.520098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:59.526580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:59.605543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.607701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.728338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17897c8-8846-4a2b-86db-445a31f7e8f7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.748037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:59.771838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.772543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.775460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 49/93] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:32:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:59.779924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:59.780122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.780446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.781336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=9cff92b0e6704fd3bfafffcd292f8e7d) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:59.781675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.783411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.798355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:32:59 2022] GET /identity/v3/role_assignments?user.id=9cff92b0e6704fd3bfafffcd292f8e7d&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=d38549e73a3b4007b78d77d91a93026f => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:32:59.799377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:32:59.901318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d04bbc-fa0a-4f14-9a0a-ecdc19accf06 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.935626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:59.947335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b992f-262b-4415-9a6a-54fd2497403b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:32:59.971049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:32:59.971755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:32:59.972042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:32:59.972321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:32:59.973168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=313ef37cfa214544815014c4f759284a) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:32:59.973485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:32:59.974955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:32:59.989083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 50/95] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:32:59 2022] GET /identity/v3/role_assignments?user.id=313ef37cfa214544815014c4f759284a&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:00.001252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e29da-7970-4488-95a0-07affbace549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:00.002136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e29da-7970-4488-95a0-07affbace549 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:00.002425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e29da-7970-4488-95a0-07affbace549 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:00.002715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e29da-7970-4488-95a0-07affbace549 None admin] PATH_INFO: `/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:00.003946 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e29da-7970-4488-95a0-07affbace549 None admin] RBAC: Authorizing `identity:get_project(project_id=bcbcabaf4e994f2fbfc8112f97ed9fec)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:00.005437 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e29da-7970-4488-95a0-07affbace549 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:00.007268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:32:59 2022] GET /identity/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:00.013926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:00.055684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:00.147472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a27710-d61c-4920-9f78-a19bf6e29b82 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:00.189558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c52a-9865-4cf5-815e-55ea17cf7c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:00.190223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c52a-9865-4cf5-815e-55ea17cf7c73 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:00.190514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c52a-9865-4cf5-815e-55ea17cf7c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:00.190796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c52a-9865-4cf5-815e-55ea17cf7c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:00.191670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c52a-9865-4cf5-815e-55ea17cf7c73 None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=bcbcabaf4e994f2fbfc8112f97ed9fec, user.id=9cff92b0e6704fd3bfafffcd292f8e7d) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:00.191984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c52a-9865-4cf5-815e-55ea17cf7c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:00.193508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c52a-9865-4cf5-815e-55ea17cf7c73 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:00.203923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:00 2022] GET /identity/v3/role_assignments?user.id=9cff92b0e6704fd3bfafffcd292f8e7d&scope.project.id=bcbcabaf4e994f2fbfc8112f97ed9fec&role.id=d38549e73a3b4007b78d77d91a93026f => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:01.571881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4ba4-674b-454d-94fb-2ad6c672892d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:01.572410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4ba4-674b-454d-94fb-2ad6c672892d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:01.572484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4ba4-674b-454d-94fb-2ad6c672892d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:01.573947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:01.580035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff309-08ed-47b1-90d3-f256d11697af None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:01.580472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff309-08ed-47b1-90d3-f256d11697af None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:01.580669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff309-08ed-47b1-90d3-f256d11697af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:01.608225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-897ff309-08ed-47b1-90d3-f256d11697af None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:01.609442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-897ff309-08ed-47b1-90d3-f256d11697af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:01.700102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:01.748880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b4ba4-674b-454d-94fb-2ad6c672892d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:01.815686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b63cad-363a-4ba3-8ee2-fa9991d32a50 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:01.816011 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b63cad-363a-4ba3-8ee2-fa9991d32a50 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:01.816260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b63cad-363a-4ba3-8ee2-fa9991d32a50 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:01.817630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 53/100] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:01.826542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1bcbb-fd60-4316-8c33-38e8c2f62c3a None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:01.826830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1bcbb-fd60-4316-8c33-38e8c2f62c3a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:01.827110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1bcbb-fd60-4316-8c33-38e8c2f62c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:01.854817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-dbb1bcbb-fd60-4316-8c33-38e8c2f62c3a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:01.856032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dbb1bcbb-fd60-4316-8c33-38e8c2f62c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:01.892048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:01.900653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b4ba4-674b-454d-94fb-2ad6c672892d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:01.936299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:01.937094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:01.937382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:01.937663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:01.938829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:01.940310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:01.941935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 48/101] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:01.948587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:01.959546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:01.989156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 54/102] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:02.029230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1bcbb-fd60-4316-8c33-38e8c2f62c3a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:02.122027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c303-7cfa-4d3d-88a3-72a3a2c80705 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:02.175049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1bcbb-fd60-4316-8c33-38e8c2f62c3a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:02.187916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df82a7-c60c-49e0-ae95-da68ab559358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:02.188603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df82a7-c60c-49e0-ae95-da68ab559358 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.188902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df82a7-c60c-49e0-ae95-da68ab559358 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.189184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df82a7-c60c-49e0-ae95-da68ab559358 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.189921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df82a7-c60c-49e0-ae95-da68ab559358 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:02.191389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df82a7-c60c-49e0-ae95-da68ab559358 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:02.224213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 49/103] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:33:01 2022] POST /identity/v3/projects => generated 302 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:02.225640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fd64-8899-4266-b81c-3e4999033fbf None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.225941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fd64-8899-4266-b81c-3e4999033fbf None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.226286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fd64-8899-4266-b81c-3e4999033fbf None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.227772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 50/104] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:02.234304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb7b5-6358-41a4-8de5-e507aefa0840 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.234601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb7b5-6358-41a4-8de5-e507aefa0840 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.234883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb7b5-6358-41a4-8de5-e507aefa0840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.253389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2b0cb7b5-6358-41a4-8de5-e507aefa0840 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:02.254615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2b0cb7b5-6358-41a4-8de5-e507aefa0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:02.264682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:02.265509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.266074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.266359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.311362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:02.323292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:02.324422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:02.326125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 55/105] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:02.335788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:02.338240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:02.369585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 51/106] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:02.380594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:02.416795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb7b5-6358-41a4-8de5-e507aefa0840 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:02.535967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d7d15-7a30-4356-bdb7-8091fefa4ef9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:02.579484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:02.580093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.580715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.580715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.581709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:02.582041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:02.583505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:02.593143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 56/107] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:02.607333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:02.648342 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb7b5-6358-41a4-8de5-e507aefa0840 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:02.718476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:02.719047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:02.719714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.720167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.721933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.750784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824fbc3-e1d5-4ffd-9ac0-4f3bdad72ab4 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:02.775865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:02.784268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:02.785333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:02.786289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:02.795179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 52/108] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:02.797457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:02.799865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d690dd-2bf5-4813-9aa1-3f9264409916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:02.805776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d690dd-2bf5-4813-9aa1-3f9264409916 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.805776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d690dd-2bf5-4813-9aa1-3f9264409916 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.805776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d690dd-2bf5-4813-9aa1-3f9264409916 None admin] PATH_INFO: `/v3/users/614c3dd766a742f2be8ec9573656f5bc` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.830496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d690dd-2bf5-4813-9aa1-3f9264409916 None admin] RBAC: Authorizing `identity:get_user(user_id=614c3dd766a742f2be8ec9573656f5bc)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:02.833441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d690dd-2bf5-4813-9aa1-3f9264409916 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:02.836593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 57/109] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:02 2022] GET /identity/v3/users/614c3dd766a742f2be8ec9573656f5bc => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:02.838135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5bb75-ca9e-40ea-812c-3101a7c2ee54 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:02.838430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5bb75-ca9e-40ea-812c-3101a7c2ee54 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:02.838716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5bb75-ca9e-40ea-812c-3101a7c2ee54 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:02.846410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 58/110] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:02.847040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5bb75-ca9e-40ea-812c-3101a7c2ee54 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:02.877352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:02.977225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d5bf-dfc6-44ed-ac8a-c08c3ae5fe9e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.012272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5bb75-ca9e-40ea-812c-3101a7c2ee54 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.050746 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4941a3-38bc-45a7-983d-12fa03bcaaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.051458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4941a3-38bc-45a7-983d-12fa03bcaaf6 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.051749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4941a3-38bc-45a7-983d-12fa03bcaaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.052033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4941a3-38bc-45a7-983d-12fa03bcaaf6 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.052789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4941a3-38bc-45a7-983d-12fa03bcaaf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:03.053104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4941a3-38bc-45a7-983d-12fa03bcaaf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:03.054507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4941a3-38bc-45a7-983d-12fa03bcaaf6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:03.072103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 53/111] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:03.080041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84b9d-1e59-44da-84f5-c69f99027fcd None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.080798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84b9d-1e59-44da-84f5-c69f99027fcd None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.081031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84b9d-1e59-44da-84f5-c69f99027fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.082605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.083303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.083596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.083878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.089667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:03.116292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1fb84b9d-1e59-44da-84f5-c69f99027fcd None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:03.117546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1fb84b9d-1e59-44da-84f5-c69f99027fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:03.208620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:03.210125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:03.246000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 54/112] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:03.246843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb84b9d-1e59-44da-84f5-c69f99027fcd None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:03.329925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:03.399098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 59/113] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:03.404346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:03.419514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb84b9d-1e59-44da-84f5-c69f99027fcd None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.441996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:03.461934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b38e-aca7-4782-b93b-2a80520bd4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.465213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b38e-aca7-4782-b93b-2a80520bd4b9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.465213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b38e-aca7-4782-b93b-2a80520bd4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.465213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b38e-aca7-4782-b93b-2a80520bd4b9 None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.465213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b38e-aca7-4782-b93b-2a80520bd4b9 None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:03.467170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b38e-aca7-4782-b93b-2a80520bd4b9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:03.473714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 55/114] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:03 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:03.473714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a4276-3f07-4303-9b6a-715a67df1892 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.473714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a4276-3f07-4303-9b6a-715a67df1892 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.473714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a4276-3f07-4303-9b6a-715a67df1892 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.473997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 56/115] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:03.475198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a4276-3f07-4303-9b6a-715a67df1892 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:03.519988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9645f-d25c-42b4-a9b3-247d8946c33e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.562261 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.563080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.564242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.564544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.576245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:03.583853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:03.585133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 60/116] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:03.585887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:03.598404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a4276-3f07-4303-9b6a-715a67df1892 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.606064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:03.634517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290790ae-e999-4bc0-82f5-f26f8d094fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.635511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290790ae-e999-4bc0-82f5-f26f8d094fcd None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.635793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290790ae-e999-4bc0-82f5-f26f8d094fcd None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.636190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290790ae-e999-4bc0-82f5-f26f8d094fcd None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.637418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290790ae-e999-4bc0-82f5-f26f8d094fcd None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:03.639027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290790ae-e999-4bc0-82f5-f26f8d094fcd None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:03.645782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 57/117] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:03 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:03.645782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d030c-99c7-4b2a-a134-aa4e13b7918e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.645782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d030c-99c7-4b2a-a134-aa4e13b7918e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.645782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d030c-99c7-4b2a-a134-aa4e13b7918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.660028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-749d030c-99c7-4b2a-a134-aa4e13b7918e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:03.661185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-749d030c-99c7-4b2a-a134-aa4e13b7918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:03.691880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:03.700003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f84931-9d84-4582-afab-9c33c6dc23d1 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.735311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.736165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.736454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.736743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.737917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:03.739441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:03.747133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 58/118] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:03.747287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 61/119] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:03 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:03.747380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8c62-1c1d-474c-b949-bf40a8139aac None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.747380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8c62-1c1d-474c-b949-bf40a8139aac None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.747380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8c62-1c1d-474c-b949-bf40a8139aac None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.747380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 59/120] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:03.747380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc8c62-1c1d-474c-b949-bf40a8139aac None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:03.747655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:03.857343 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb41b6-20f0-4a9e-9105-0b5133114aaa None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.863103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc8c62-1c1d-474c-b949-bf40a8139aac None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:03.866457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:03.901887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.902582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.902880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.903170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.904682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] RBAC: Adding query filter params (role.id=382848c6a3eb409bbfb0a21dd9ed2197, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=614c3dd766a742f2be8ec9573656f5bc) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:03.905122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:03.906597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:03.911264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f77f2-0e8d-4556-93a3-85a6b9816e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:03.912216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f77f2-0e8d-4556-93a3-85a6b9816e2f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.912727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 60/121] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:03 2022] GET /identity/v3/role_assignments?user.id=614c3dd766a742f2be8ec9573656f5bc&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=382848c6a3eb409bbfb0a21dd9ed2197 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:03.912829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f77f2-0e8d-4556-93a3-85a6b9816e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.913071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f77f2-0e8d-4556-93a3-85a6b9816e2f None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.914422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f77f2-0e8d-4556-93a3-85a6b9816e2f None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:03.914793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f77f2-0e8d-4556-93a3-85a6b9816e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:03.916372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f77f2-0e8d-4556-93a3-85a6b9816e2f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:03.920174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:03.930508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 62/122] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:03.933494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669b6c-c80f-4efa-b21a-498c00ab4c9f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:03.935170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669b6c-c80f-4efa-b21a-498c00ab4c9f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:03.935731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669b6c-c80f-4efa-b21a-498c00ab4c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:03.959762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3b669b6c-c80f-4efa-b21a-498c00ab4c9f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:03.961654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3b669b6c-c80f-4efa-b21a-498c00ab4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:03.987247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.058690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 63/123] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:04.060457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b669b6c-c80f-4efa-b21a-498c00ab4c9f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.066050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65db54-3a96-4fdf-98e3-1c9363014b61 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.112351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.113257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.113546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.113830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/9cff92b0e6704fd3bfafffcd292f8e7d/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.116321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee573fc7a3445568d49498c20f3ed88, user_id=9cff92b0e6704fd3bfafffcd292f8e7d, role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:04.117801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:04.135138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 61/124] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:03 2022] PUT /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/9cff92b0e6704fd3bfafffcd292f8e7d/roles/7375d2caebd143e29bfb064c04af61e7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:04.136077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.172643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.185825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b669b6c-c80f-4efa-b21a-498c00ab4c9f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.224031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.224846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.225141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.225428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.246209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:04.255065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:04.256044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:04.256803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:04.264987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 64/125] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:04.266162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.273137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bbcd-df6b-4290-808b-a949e8c509af None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.295960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.315863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.316769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.317174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.317467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.318848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:04.320463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:04.322371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 62/126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:04.323166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.429055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f4e43-73c3-4c0e-ab46-6477c8569094 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.469807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.470960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.471478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.471953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.476302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.486617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:04.494903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:04.495829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:04.496590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:04.498994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 65/127] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:04.500012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.501211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795ba2c-8c40-4b68-a6eb-1e0b5c29d1d5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.582078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.604556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.605174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.605467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.605750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.607076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:04.607441 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:04.608830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:04.612731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b6d59-08e1-45c6-b988-308adb97f37f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.630822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 63/128] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:04.635310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.663090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.664444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.664928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.665397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.666949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:04.669032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:04.679624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 66/129] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:04.680472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.797479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc626e3-9095-45f0-98ba-c64296353096 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.798008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fa372-5b51-40e6-bb64-b01e302a874b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.831724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.832496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.832881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.833175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.834089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] RBAC: Adding query filter params (name=member) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:04.834407 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:04.835903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:04.846912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 64/130] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:04.847593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.857642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.858539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.858831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.859116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] PATH_INFO: `/v3/users/313ef37cfa214544815014c4f759284a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:04.860436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] RBAC: Authorizing `identity:get_user(user_id=313ef37cfa214544815014c4f759284a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:04.861908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:04.863588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 67/131] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/users/313ef37cfa214544815014c4f759284a => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:04.864354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:04.871612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.878019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:04.959753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bbe4f-e89d-4ed2-a137-1274be266f1f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:04.995951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:04.996895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:04.997725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:04.998011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/9cff92b0e6704fd3bfafffcd292f8e7d/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.000267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee573fc7a3445568d49498c20f3ed88, user_id=9cff92b0e6704fd3bfafffcd292f8e7d, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:05.002001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:05.023531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 65/132] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:04 2022] PUT /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/9cff92b0e6704fd3bfafffcd292f8e7d/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:05.024187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:05.130993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c10a77-dc04-4e7b-b52f-714f3cc1fe24 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:05.202180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:05.216127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def56b8-7b63-4a3b-82c0-e65cd7390819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:05.217140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def56b8-7b63-4a3b-82c0-e65cd7390819 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.217599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def56b8-7b63-4a3b-82c0-e65cd7390819 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.217889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def56b8-7b63-4a3b-82c0-e65cd7390819 None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.222808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def56b8-7b63-4a3b-82c0-e65cd7390819 None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:05.224175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff570e-220a-492c-bc8a-27de03c19523 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:05.224454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def56b8-7b63-4a3b-82c0-e65cd7390819 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:05.226272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 68/133] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:04 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:05.227788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dbc2e-cf39-4b1b-81c8-26a6b6af7da8 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.227788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dbc2e-cf39-4b1b-81c8-26a6b6af7da8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.228211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dbc2e-cf39-4b1b-81c8-26a6b6af7da8 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.229342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 69/134] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:05.240427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dbc2e-cf39-4b1b-81c8-26a6b6af7da8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:05.266757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3f76-06a3-4f39-a912-26bf0bae3827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:05.267895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3f76-06a3-4f39-a912-26bf0bae3827 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.268320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3f76-06a3-4f39-a912-26bf0bae3827 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.268768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3f76-06a3-4f39-a912-26bf0bae3827 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.271181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3f76-06a3-4f39-a912-26bf0bae3827 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:05.273157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3f76-06a3-4f39-a912-26bf0bae3827 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:05.275728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 66/135] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:05 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:05.277313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64f80c-da72-4d49-9702-b891e79ab6b5 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.277988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64f80c-da72-4d49-9702-b891e79ab6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.278855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64f80c-da72-4d49-9702-b891e79ab6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.299883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-dd64f80c-da72-4d49-9702-b891e79ab6b5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:05.301776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-dd64f80c-da72-4d49-9702-b891e79ab6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:05.335452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:05.359322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dbc2e-cf39-4b1b-81c8-26a6b6af7da8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:05.394019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 67/136] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:05.395182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64f80c-da72-4d49-9702-b891e79ab6b5 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:05.396443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:05.397391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.397751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.403228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] PATH_INFO: `/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.404135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] RBAC: Authorizing `identity:get_project(project_id=bcbcabaf4e994f2fbfc8112f97ed9fec)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:05.405619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:05.407412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 70/137] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:05 2022] GET /identity/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:05.413824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:05.500556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:05.527860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64f80c-da72-4d49-9702-b891e79ab6b5 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:05.598321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:05.599299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.599635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.599868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/313ef37cfa214544815014c4f759284a/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.603495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee573fc7a3445568d49498c20f3ed88, user_id=313ef37cfa214544815014c4f759284a, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:05.604974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:05.630736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 68/138] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:05 2022] PUT /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/313ef37cfa214544815014c4f759284a/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:05.631670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:05.652711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44bbd7-938d-4f9d-b7b7-3957d2380c3d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:05.721614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:05.722588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.722887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.723172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] PATH_INFO: `/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec/users/9cff92b0e6704fd3bfafffcd292f8e7d/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.725450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcbcabaf4e994f2fbfc8112f97ed9fec, user_id=9cff92b0e6704fd3bfafffcd292f8e7d, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:05.727309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:05.744222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 71/139] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:05 2022] PUT /identity/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec/users/9cff92b0e6704fd3bfafffcd292f8e7d/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:33:05.846450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f308-e5b1-4272-98ff-6507cb212f2d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:05.895770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82e562-efdb-4665-8d3a-b859d060d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:05.896589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82e562-efdb-4665-8d3a-b859d060d577 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:05.896877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82e562-efdb-4665-8d3a-b859d060d577 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:05.897161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82e562-efdb-4665-8d3a-b859d060d577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:05.900892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82e562-efdb-4665-8d3a-b859d060d577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:05.902388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82e562-efdb-4665-8d3a-b859d060d577 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:05.905070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 69/140] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:05.910488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:05.949996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:06.044533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce650-8183-4c06-b1be-66277ad1f769 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:06.078567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2faab-cad6-4465-a903-c9703fb56b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:06.079273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2faab-cad6-4465-a903-c9703fb56b69 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:06.079569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2faab-cad6-4465-a903-c9703fb56b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:06.079858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2faab-cad6-4465-a903-c9703fb56b69 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:06.080592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2faab-cad6-4465-a903-c9703fb56b69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:06.082160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2faab-cad6-4465-a903-c9703fb56b69 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:06.110699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 72/141] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:05 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:06.337461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a9ae-064d-4946-beed-1e4dd3328e5e None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:06.338138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a9ae-064d-4946-beed-1e4dd3328e5e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:06.338640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a9ae-064d-4946-beed-1e4dd3328e5e None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:06.340526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 70/142] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:06.346120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cdb9d-4771-445f-839e-b1a3931e8a2e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:06.346683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cdb9d-4771-445f-839e-b1a3931e8a2e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:06.347186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cdb9d-4771-445f-839e-b1a3931e8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:06.369083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-516cdb9d-4771-445f-839e-b1a3931e8a2e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:06.370272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-516cdb9d-4771-445f-839e-b1a3931e8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:06.438545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:06.450804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 73/143] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:06.485701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a9ae-064d-4946-beed-1e4dd3328e5e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:06.495039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:06.649990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a9ae-064d-4946-beed-1e4dd3328e5e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:06.696903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:06.697710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:06.698003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:06.698291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:06.709153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:06.717325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:06.718215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:06.719027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 71/144] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:06.724267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cdb9d-4771-445f-839e-b1a3931e8a2e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:06.839589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cdb9d-4771-445f-839e-b1a3931e8a2e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:06.881048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:06.881732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:06.882023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:06.882350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:06.883115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:06.883453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:06.884862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:06.897678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 74/145] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:06.903423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:07.012984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:07.049834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720f09c-e345-42b6-b55d-bf2b0bff8b7c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:07.087723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff1d09-f05f-4e4c-96a4-1d158c414125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:07.088609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff1d09-f05f-4e4c-96a4-1d158c414125 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.088949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff1d09-f05f-4e4c-96a4-1d158c414125 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.089187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff1d09-f05f-4e4c-96a4-1d158c414125 None admin] PATH_INFO: `/v3/users/614c3dd766a742f2be8ec9573656f5bc` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.090399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff1d09-f05f-4e4c-96a4-1d158c414125 None admin] RBAC: Authorizing `identity:get_user(user_id=614c3dd766a742f2be8ec9573656f5bc)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:07.091918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff1d09-f05f-4e4c-96a4-1d158c414125 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:07.094528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 72/146] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:06 2022] GET /identity/v3/users/614c3dd766a742f2be8ec9573656f5bc => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:07.098942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:07.191842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:07.193151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ceb5b-3bd2-4618-bbd3-978c94285dc7 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.193447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ceb5b-3bd2-4618-bbd3-978c94285dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.193733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ceb5b-3bd2-4618-bbd3-978c94285dc7 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.195339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 73/147] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:07.201068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35bb10-428a-4b6a-aaeb-e245ee338d4c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.201379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35bb10-428a-4b6a-aaeb-e245ee338d4c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.201642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35bb10-428a-4b6a-aaeb-e245ee338d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.235631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-cf35bb10-428a-4b6a-aaeb-e245ee338d4c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:07.236846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cf35bb10-428a-4b6a-aaeb-e245ee338d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:07.244790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d927c4-6509-413b-ac16-3ebcd0b67916 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:07.291700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:07.292576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.292868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.293146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.298918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:07.300479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:07.302591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 75/148] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:07 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:07.307710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:07.401386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 74/149] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:07.425510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35bb10-428a-4b6a-aaeb-e245ee338d4c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:07.492888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ade24-41a2-4068-a77d-8cbb8fce9b91 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:07.508612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:07.532881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:07.549409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35bb10-428a-4b6a-aaeb-e245ee338d4c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:07.563193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:07.564489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.565001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.565478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/614c3dd766a742f2be8ec9573656f5bc/roles/382848c6a3eb409bbfb0a21dd9ed2197` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.567702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee573fc7a3445568d49498c20f3ed88, user_id=614c3dd766a742f2be8ec9573656f5bc, role_id=382848c6a3eb409bbfb0a21dd9ed2197)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:07.569375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:07.601655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 76/150] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:07 2022] PUT /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88/users/614c3dd766a742f2be8ec9573656f5bc/roles/382848c6a3eb409bbfb0a21dd9ed2197 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:33:07.607283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:07.607283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.607283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.607283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.617501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:07.626300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:07.627241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:07.628050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:07.629200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 75/151] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:07.633871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:07.757712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4293f69-286c-4ba6-b3f3-cf28bcafe823 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:07.795738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:07.796430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.796719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.797008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.797788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:07.798106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:07.799529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:07.813247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 77/152] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:07.814598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:07.924111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff517ea4-5b74-425c-b8e1-8455a0d14e20 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:07.955794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:07.960688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6ae2c-1833-4c33-b445-bae21331018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:07.961578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6ae2c-1833-4c33-b445-bae21331018a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:07.961870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6ae2c-1833-4c33-b445-bae21331018a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:07.962156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6ae2c-1833-4c33-b445-bae21331018a None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:07.963436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6ae2c-1833-4c33-b445-bae21331018a None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:07.964911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6ae2c-1833-4c33-b445-bae21331018a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:07.971271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 76/153] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:07 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:07.972655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:08.030599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:08.097092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c21b3-6f58-48d8-9ff5-2ef4b7e8965f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:08.133665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:08.134327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.134619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.134901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.226414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:08.227954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:08.262373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c628b0-ab21-4ac5-b590-d537773e70b0 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.262740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c628b0-ab21-4ac5-b590-d537773e70b0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.262981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c628b0-ab21-4ac5-b590-d537773e70b0 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.264396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 77/154] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:08.270012 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a1b41-2301-4e4c-a6a5-1f334c2c106f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.270302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a1b41-2301-4e4c-a6a5-1f334c2c106f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.270588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a1b41-2301-4e4c-a6a5-1f334c2c106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.292376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-c04a1b41-2301-4e4c-a6a5-1f334c2c106f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:08.293495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c04a1b41-2301-4e4c-a6a5-1f334c2c106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:08.329246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:08.423062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 78/155] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:08.457840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 78/156] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:08.459561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a1b41-2301-4e4c-a6a5-1f334c2c106f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:08.474544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:08.654373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a1b41-2301-4e4c-a6a5-1f334c2c106f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:08.656578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e845fb-a673-4bbb-9e84-aef5e3f0049e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:08.698928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:08.719755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:08.720569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.721256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.721544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.723134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:08.724024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:08.724534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:08.724818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:08.727192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:08.728673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:08.730396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 79/157] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:08 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:08.739346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:08.753492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:08.761334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:08.763354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:08.764140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 79/158] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:08.772430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:08.781377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:08.973261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0436a7-cf94-453d-9d4f-f8fe886a0904 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:09.006477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652a3dd-7fd1-4818-a1a8-b8fcbb7d4684 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:09.050833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:09.051533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.051826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.052112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.052961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] RBAC: Adding query filter params (role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=9cff92b0e6704fd3bfafffcd292f8e7d) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:09.053279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:09.054742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:09.073569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 80/159] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:08 2022] GET /identity/v3/role_assignments?user.id=9cff92b0e6704fd3bfafffcd292f8e7d&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:09.092032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2297e1d-f3a5-4c7a-a6bd-e9ac2156c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:09.092748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2297e1d-f3a5-4c7a-a6bd-e9ac2156c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.093043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2297e1d-f3a5-4c7a-a6bd-e9ac2156c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.093331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2297e1d-f3a5-4c7a-a6bd-e9ac2156c5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.094123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2297e1d-f3a5-4c7a-a6bd-e9ac2156c5b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:09.094441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2297e1d-f3a5-4c7a-a6bd-e9ac2156c5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:09.095950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2297e1d-f3a5-4c7a-a6bd-e9ac2156c5b3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:09.105519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 80/160] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:09.111710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:09.144026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205315-c333-434f-99e7-5a7d2c89d894 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.144338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205315-c333-434f-99e7-5a7d2c89d894 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.144611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205315-c333-434f-99e7-5a7d2c89d894 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.146383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 81/161] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:09.165154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08fa8-5a25-48ac-8ced-06771a8cdf08 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.165789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08fa8-5a25-48ac-8ced-06771a8cdf08 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.166086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08fa8-5a25-48ac-8ced-06771a8cdf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.196607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-6ad08fa8-5a25-48ac-8ced-06771a8cdf08 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:09.198008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-6ad08fa8-5a25-48ac-8ced-06771a8cdf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:09.222509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:09.293771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:09.307931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754fb08-e399-4fd2-ade8-bf48a4d5e4af None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:09.308996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 82/162] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:09.358981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:09.359906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.360198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.360482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.362809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:09.363930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08fa8-5a25-48ac-8ced-06771a8cdf08 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:09.364350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:09.366317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 81/163] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:09 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:09.371731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:09.520990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a664-9c5d-421b-84d2-768fcf3c2b5f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:09.547578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08fa8-5a25-48ac-8ced-06771a8cdf08 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:09.559366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:09.570354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:09.571071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.571485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.571779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.589643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:09.591261 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.591699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.592123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.603065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:09.614314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:09.615237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:09.616056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:09.619060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 83/164] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:09.624283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:09.647172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:09.648810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:09.691643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:09.743829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d2975-cee7-46fc-b7cf-f107c09f0908 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:09.756839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 82/165] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:09.762025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:09.788791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:09.798656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:09.799871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:09.800329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:09.800972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:09.802000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:09.802450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:09.804034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:09.820825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 84/166] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:09.828192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:09.971059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5010-7861-408b-9131-4e32e16dc18b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:10.040507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d25cc-d6f4-458a-99b7-9126cd665d9e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:10.087936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:10.088821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.089109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.089389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.090623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:10.091725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:10.092649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:10.094650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 83/167] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:09 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:10.102414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:10.125915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc209-5994-4319-9b08-935506022c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:10.126812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc209-5994-4319-9b08-935506022c64 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.127100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc209-5994-4319-9b08-935506022c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.127407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc209-5994-4319-9b08-935506022c64 None admin] PATH_INFO: `/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.128732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fc209-5994-4319-9b08-935506022c64 None admin] RBAC: Authorizing `identity:get_user(user_id=9cff92b0e6704fd3bfafffcd292f8e7d)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:10.130212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fc209-5994-4319-9b08-935506022c64 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:10.132179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 85/168] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:09 2022] GET /identity/v3/users/9cff92b0e6704fd3bfafffcd292f8e7d => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:10.140321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc209-5994-4319-9b08-935506022c64 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:10.256546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:10.267372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ac8f-c04d-4bc9-a694-45397816ea30 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:10.315934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d278a8-28ff-4876-864d-d731fb66581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:10.316602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d278a8-28ff-4876-864d-d731fb66581f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.317047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d278a8-28ff-4876-864d-d731fb66581f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.317480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d278a8-28ff-4876-864d-d731fb66581f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.318469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d278a8-28ff-4876-864d-d731fb66581f None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=9cff92b0e6704fd3bfafffcd292f8e7d) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:10.318922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d278a8-28ff-4876-864d-d731fb66581f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:10.320537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d278a8-28ff-4876-864d-d731fb66581f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:10.327859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 84/169] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:10 2022] GET /identity/v3/role_assignments?user.id=9cff92b0e6704fd3bfafffcd292f8e7d&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=d38549e73a3b4007b78d77d91a93026f => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:10.329291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cdb34-6fe6-4f66-99dc-7604c0b9d641 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.329718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cdb34-6fe6-4f66-99dc-7604c0b9d641 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.330134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cdb34-6fe6-4f66-99dc-7604c0b9d641 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.339796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 85/170] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:10.345945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e4b54-8040-4da7-b323-ccda35558613 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.346471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e4b54-8040-4da7-b323-ccda35558613 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.346911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e4b54-8040-4da7-b323-ccda35558613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.374060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc209-5994-4319-9b08-935506022c64 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:10.375247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-3d7e4b54-8040-4da7-b323-ccda35558613 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:10.376588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3d7e4b54-8040-4da7-b323-ccda35558613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:10.461525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:10.462203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.462496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.462779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.513053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 86/171] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:10.554767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e4b54-8040-4da7-b323-ccda35558613 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:10.591661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:10.621511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:10.623457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:10.707806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:10.735076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e4b54-8040-4da7-b323-ccda35558613 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:10.797651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:10.798467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:10.798756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:10.799037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:10.816366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:10.829945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:10.831125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:10.832121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:10.834467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 87/172] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:10.839990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:10.874365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 86/173] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:10.880191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:10.962875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac91e-de23-4907-ad86-04da53c767b7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:10.999652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.012497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237cee6-6852-4a97-b618-ffdd31e82c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.013374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237cee6-6852-4a97-b618-ffdd31e82c85 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.014063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237cee6-6852-4a97-b618-ffdd31e82c85 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.014358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237cee6-6852-4a97-b618-ffdd31e82c85 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.015401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237cee6-6852-4a97-b618-ffdd31e82c85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:11.015969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237cee6-6852-4a97-b618-ffdd31e82c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.017651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237cee6-6852-4a97-b618-ffdd31e82c85 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.021072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1808-586a-42e2-8df9-ed482030a77b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.028745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 88/174] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:11.030587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490399f-0e93-441d-b8fa-b9dfa1d98a40 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.030878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490399f-0e93-441d-b8fa-b9dfa1d98a40 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.031162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490399f-0e93-441d-b8fa-b9dfa1d98a40 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.033154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 89/175] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:11.038063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e03336-ac35-497d-a5a2-cc5c3ff67b49 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.038433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e03336-ac35-497d-a5a2-cc5c3ff67b49 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.038785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e03336-ac35-497d-a5a2-cc5c3ff67b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.052786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.058694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d2e03336-ac35-497d-a5a2-cc5c3ff67b49 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:11.061810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d2e03336-ac35-497d-a5a2-cc5c3ff67b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:11.069100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.069985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.070271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.070549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] PATH_INFO: `/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.071784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] RBAC: Authorizing `identity:get_project(project_id=bcbcabaf4e994f2fbfc8112f97ed9fec)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.073564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.075433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 87/176] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:10 2022] GET /identity/v3/projects/bcbcabaf4e994f2fbfc8112f97ed9fec => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:11.076241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.138491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 90/177] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:11.139936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e03336-ac35-497d-a5a2-cc5c3ff67b49 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.191417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be087f-3e76-4966-9f51-e3614fc9baac None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.230551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.232386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.232878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.233333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] PATH_INFO: `/v3/users/313ef37cfa214544815014c4f759284a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.234936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] RBAC: Authorizing `identity:get_user(user_id=313ef37cfa214544815014c4f759284a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.236708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.238620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 88/178] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/users/313ef37cfa214544815014c4f759284a => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:11.239699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.243059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e03336-ac35-497d-a5a2-cc5c3ff67b49 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.266795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.277514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.278852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.278994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.283248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.283248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=bcbcabaf4e994f2fbfc8112f97ed9fec, user.id=9cff92b0e6704fd3bfafffcd292f8e7d) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:11.283248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.283248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.285574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.288773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 91/179] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/role_assignments?user.id=9cff92b0e6704fd3bfafffcd292f8e7d&scope.project.id=bcbcabaf4e994f2fbfc8112f97ed9fec&role.id=d38549e73a3b4007b78d77d91a93026f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:11.289883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.424233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5dd15-d758-4edc-b229-31234bd93582 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.467254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95bdf-e093-4bf6-88cc-8349612973ae None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.504178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd639-edd1-42ec-89a4-ccaa1ac5a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.505044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd639-edd1-42ec-89a4-ccaa1ac5a317 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.505335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd639-edd1-42ec-89a4-ccaa1ac5a317 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.505614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd639-edd1-42ec-89a4-ccaa1ac5a317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.510458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b012f6-e265-497c-9cf0-01003e5c22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.511309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b012f6-e265-497c-9cf0-01003e5c22f3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.511600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b012f6-e265-497c-9cf0-01003e5c22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.511881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b012f6-e265-497c-9cf0-01003e5c22f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.545725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b012f6-e265-497c-9cf0-01003e5c22f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-18b012f6-e265-497c-9cf0-01003e5c22f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:11.553506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:11.554387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:11.555177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 89/180] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:11.556176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898750ce-e67a-47d4-9dc6-4fea5aea6eb1 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.556278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898750ce-e67a-47d4-9dc6-4fea5aea6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.557212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898750ce-e67a-47d4-9dc6-4fea5aea6eb1 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.558017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 90/181] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:11.559094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f30a-e5fc-4ff7-a789-a9406eb8c96e None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.560699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f30a-e5fc-4ff7-a789-a9406eb8c96e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.560987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f30a-e5fc-4ff7-a789-a9406eb8c96e None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.562252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 91/182] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:11.563249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f30a-e5fc-4ff7-a789-a9406eb8c96e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.591587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.594872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bd639-edd1-42ec-89a4-ccaa1ac5a317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.596402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bd639-edd1-42ec-89a4-ccaa1ac5a317 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.669649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.690289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f30a-e5fc-4ff7-a789-a9406eb8c96e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.713883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 92/183] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:11.713883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88836787-7c5b-48e6-a25a-1adce15b94f5 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.713883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88836787-7c5b-48e6-a25a-1adce15b94f5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.713883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88836787-7c5b-48e6-a25a-1adce15b94f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.728762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-88836787-7c5b-48e6-a25a-1adce15b94f5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:11.729473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f235b5-d33c-4328-9b6a-a63eb1c80e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.729937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-88836787-7c5b-48e6-a25a-1adce15b94f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:11.730158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f235b5-d33c-4328-9b6a-a63eb1c80e42 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.730447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f235b5-d33c-4328-9b6a-a63eb1c80e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.730731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f235b5-d33c-4328-9b6a-a63eb1c80e42 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.731572 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f235b5-d33c-4328-9b6a-a63eb1c80e42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:11.731889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f235b5-d33c-4328-9b6a-a63eb1c80e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.733317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f235b5-d33c-4328-9b6a-a63eb1c80e42 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.741745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 92/184] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:11.743029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71830-5094-436b-88a4-5c3ef9bcfd3d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.743365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71830-5094-436b-88a4-5c3ef9bcfd3d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.743633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71830-5094-436b-88a4-5c3ef9bcfd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.759700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f3d71830-5094-436b-88a4-5c3ef9bcfd3d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:11.760888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f3d71830-5094-436b-88a4-5c3ef9bcfd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:11.796037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 93/185] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:11.800075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88836787-7c5b-48e6-a25a-1adce15b94f5 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.839738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 93/186] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:11.839920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.839996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba50bf-a387-4b4d-a99a-59b1b7e95351 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.839996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba50bf-a387-4b4d-a99a-59b1b7e95351 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.839996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba50bf-a387-4b4d-a99a-59b1b7e95351 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.839996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 94/187] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:11.839996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba50bf-a387-4b4d-a99a-59b1b7e95351 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.900494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88836787-7c5b-48e6-a25a-1adce15b94f5 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.914035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:11.934971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.935854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.936135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.936403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.937568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.938998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.939631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba50bf-a387-4b4d-a99a-59b1b7e95351 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:11.940761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 94/188] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:11.941462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:11.973010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada294c-a488-4a04-910f-df5c3fb47eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:11.973882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada294c-a488-4a04-910f-df5c3fb47eee None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.974165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada294c-a488-4a04-910f-df5c3fb47eee None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.974442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada294c-a488-4a04-910f-df5c3fb47eee None admin] PATH_INFO: `/v3/users/1af9c4275593447e9a62071eb6376a2f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:11.987215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada294c-a488-4a04-910f-df5c3fb47eee None admin] RBAC: Authorizing `identity:get_user(user_id=1af9c4275593447e9a62071eb6376a2f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:11.988689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada294c-a488-4a04-910f-df5c3fb47eee None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:11.990339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 95/189] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/users/1af9c4275593447e9a62071eb6376a2f => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:11.990339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513152-6618-4304-aebb-c3cf6ead6ea6 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:11.990339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513152-6618-4304-aebb-c3cf6ead6ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:11.990339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513152-6618-4304-aebb-c3cf6ead6ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.007979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-45513152-6618-4304-aebb-c3cf6ead6ea6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:12.009158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-45513152-6618-4304-aebb-c3cf6ead6ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:12.035843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.039906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d34c-deea-424d-b05b-8a8ef86b5ea2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.074270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 96/190] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:12.074520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.075624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45513152-6618-4304-aebb-c3cf6ead6ea6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.076614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.076906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.077177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.089362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:12.097107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:12.098034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:12.098832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 95/191] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:12.099525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.136311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.176364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45513152-6618-4304-aebb-c3cf6ead6ea6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.195882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac18553-3c1e-4c38-bf84-dd5db7352986 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.209969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.210788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.211068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.211365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.212533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.213994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.215651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 97/192] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:12.216390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.232993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.233656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.233946 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.234243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.235082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=313ef37cfa214544815014c4f759284a) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:12.235438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.236874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.242598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 96/193] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/role_assignments?user.id=313ef37cfa214544815014c4f759284a&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:12.243396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.277292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.327162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd5146-cb74-4901-a1af-e2b6d53b4895 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.359529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.362873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf6dd-9d88-4e9a-90f2-6ce0e16063cc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.367354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.368033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.368323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.368605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.404278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.405201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.405378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.405658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.416844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:12.425526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:12.426490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:12.427393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 97/194] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:12.428068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.453361 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.454777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.529415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.548283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0aef-4c81-43a5-943e-2aa752f05a9c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.569789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 98/195] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:12.570694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.581117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.581781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.582067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.582350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.583092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:12.583429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.584797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.593717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 98/196] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:12.594428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.601550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.669860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01e6b-2eab-4afb-8afe-ad183e5bd2ef None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.692917 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe9d3-550c-462b-90e4-b1b9c39af256 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.702753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.703563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.703791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.704070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.704776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.706222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.725348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 99/197] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:12 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:12.726136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.734086 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.734780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.735067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.735400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.736206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:12.736532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.737973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.747647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 99/198] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:12.748353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.758105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.830398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:12.851806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c92d-8217-4792-84d1-ab8889a77f25 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.865101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf672b3d-d740-46f3-b805-191b36feccdc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:12.891431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.892309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.892600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.892885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.894101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.896348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.897427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 100/199] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:12.899226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:12.909985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:12.910876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:12.911597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:12.911893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] PATH_INFO: `/v3/users/614c3dd766a742f2be8ec9573656f5bc` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:12.913393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] RBAC: Authorizing `identity:get_user(user_id=614c3dd766a742f2be8ec9573656f5bc)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:12.914852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:12.916523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 100/200] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/users/614c3dd766a742f2be8ec9573656f5bc => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:12.922294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:13.010571 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:13.026799 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b7b6-f537-444b-8831-ce44dc42dc06 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.045903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88877f9-2156-45db-ab1b-6ac30a6dcd16 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.070754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.072023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.072132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.072418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] PATH_INFO: `/v3/users/1af9c4275593447e9a62071eb6376a2f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.074094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] RBAC: Authorizing `identity:get_user(user_id=1af9c4275593447e9a62071eb6376a2f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.075541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:13.076980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 101/201] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/users/1af9c4275593447e9a62071eb6376a2f => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:13.077867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:13.091166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.092150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.092576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.093003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.093987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=1af9c4275593447e9a62071eb6376a2f) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:13.094498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.096165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:13.102232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 101/202] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:12 2022] GET /identity/v3/role_assignments?user.id=1af9c4275593447e9a62071eb6376a2f&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:13.103359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:13.112893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:13.208484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5c6ba-f6c0-4f69-9ca3-fa4f58588be6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.215339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac9cb5-4ade-4759-9484-79a0b5ed682d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.253093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.254552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.256392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.257212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.257738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.259272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.260112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.262615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.279664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:13.347282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.349048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:13.393971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.395646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:13.447591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:13.454915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 102/203] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:13.467607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:13.558714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:13.626760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a3f40-334d-4516-82e0-ebb8d9a4b6ee None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.650120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:13.655920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:13.665573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.666447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.666731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.667010 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.668221 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.669717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:13.671833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 103/205] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:13 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:13.678039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:13.790828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431614a4-a548-43d4-a4cc-68208c54cee0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.803226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:13.841355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.842118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.842405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.842687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.843543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] RBAC: Adding query filter params (role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=1af9c4275593447e9a62071eb6376a2f) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:13.844103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.845645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:13.862061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 104/206] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:13 2022] GET /identity/v3/role_assignments?user.id=1af9c4275593447e9a62071eb6376a2f&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:13.867033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7f4d6-463e-466b-8ee5-e5e74e105d73 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:13.892856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:13.906003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcc285-deb6-4c0e-8d45-efbdc7937169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:13.907149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc285-deb6-4c0e-8d45-efbdc7937169 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:13.907469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc285-deb6-4c0e-8d45-efbdc7937169 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:13.907752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc285-deb6-4c0e-8d45-efbdc7937169 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:13.909059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcc285-deb6-4c0e-8d45-efbdc7937169 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:13.910743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcc285-deb6-4c0e-8d45-efbdc7937169 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:13.912950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 103/207] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:13 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:13.919504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:14.036603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0238f-caa4-4e85-930a-89ed17933d84 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:14.084256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56b7d-15a2-41f1-a3a1-25388b9b2b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:14.084932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56b7d-15a2-41f1-a3a1-25388b9b2b08 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:14.085222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56b7d-15a2-41f1-a3a1-25388b9b2b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:14.085498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56b7d-15a2-41f1-a3a1-25388b9b2b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:14.086341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56b7d-15a2-41f1-a3a1-25388b9b2b08 None admin] RBAC: Adding query filter params (role.id=382848c6a3eb409bbfb0a21dd9ed2197, scope.project.id=5ee573fc7a3445568d49498c20f3ed88, user.id=614c3dd766a742f2be8ec9573656f5bc) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:14.086655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56b7d-15a2-41f1-a3a1-25388b9b2b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:14.088129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56b7d-15a2-41f1-a3a1-25388b9b2b08 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:14.100453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 105/208] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:13 2022] GET /identity/v3/role_assignments?user.id=614c3dd766a742f2be8ec9573656f5bc&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=382848c6a3eb409bbfb0a21dd9ed2197 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:15.115777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33596-0130-41ba-85fc-0ade3388e758 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.116290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33596-0130-41ba-85fc-0ade3388e758 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.116395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33596-0130-41ba-85fc-0ade3388e758 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.117919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 104/209] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:15.123332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d40f7-3dc7-48b8-9c5b-cf2aebe6b56f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.123752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d40f7-3dc7-48b8-9c5b-cf2aebe6b56f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.123936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d40f7-3dc7-48b8-9c5b-cf2aebe6b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.141466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4e3d40f7-3dc7-48b8-9c5b-cf2aebe6b56f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:15.142658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4e3d40f7-3dc7-48b8-9c5b-cf2aebe6b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:15.153871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae83d-b12d-4bce-89ba-a5ff1d8788f8 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.154158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae83d-b12d-4bce-89ba-a5ff1d8788f8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.154434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae83d-b12d-4bce-89ba-a5ff1d8788f8 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.156090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 105/210] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:15.161154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ecbae-fabf-4fa4-a891-99782cddc35b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.161446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ecbae-fabf-4fa4-a891-99782cddc35b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.161729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ecbae-fabf-4fa4-a891-99782cddc35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.174726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:15.179827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5f3ecbae-fabf-4fa4-a891-99782cddc35b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:15.181276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5f3ecbae-fabf-4fa4-a891-99782cddc35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:15.222319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 106/211] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:15.247009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d40f7-3dc7-48b8-9c5b-cf2aebe6b56f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.265245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:15.289993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ecbae-fabf-4fa4-a891-99782cddc35b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.355017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d40f7-3dc7-48b8-9c5b-cf2aebe6b56f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.387912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ecbae-fabf-4fa4-a891-99782cddc35b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.400766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.400766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.400766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.400766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.411493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:15.412302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:15.421019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:15.421924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:15.422704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:15.430916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.430916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.430916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.430916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.431251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:15.431251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:15.431612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 107/213] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:15.432665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.433048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 107/214] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:15.439168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.460695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:15.543406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567efb4-d461-43ec-978d-7c67f867a3c7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.557429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3fc58-0c9a-4c70-a25c-62816228ce58 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.578145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5d9a-9fc8-4a86-9ebb-cc18e903d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.578815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5d9a-9fc8-4a86-9ebb-cc18e903d880 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.579097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5d9a-9fc8-4a86-9ebb-cc18e903d880 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.579403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5d9a-9fc8-4a86-9ebb-cc18e903d880 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.580142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5d9a-9fc8-4a86-9ebb-cc18e903d880 None admin] RBAC: Adding query filter params (name=member) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:15.580450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5d9a-9fc8-4a86-9ebb-cc18e903d880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:15.581821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5d9a-9fc8-4a86-9ebb-cc18e903d880 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:15.589839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 108/215] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:15.591594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ff35e-e2ad-458a-8819-5bc327679239 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.591870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ff35e-e2ad-458a-8819-5bc327679239 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.592150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ff35e-e2ad-458a-8819-5bc327679239 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.593497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 109/216] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:15.595193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48653d-c295-4a51-9bc2-84cd5a77fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.595674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ff35e-e2ad-458a-8819-5bc327679239 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.596411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48653d-c295-4a51-9bc2-84cd5a77fb27 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.596885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48653d-c295-4a51-9bc2-84cd5a77fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.597418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48653d-c295-4a51-9bc2-84cd5a77fb27 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.598133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48653d-c295-4a51-9bc2-84cd5a77fb27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:15.599857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48653d-c295-4a51-9bc2-84cd5a77fb27 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:15.627999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 108/217] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:15 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:15.630246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f0f9a-3211-4e5c-8e94-4c6fe085bdcf None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.630599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f0f9a-3211-4e5c-8e94-4c6fe085bdcf None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.630943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f0f9a-3211-4e5c-8e94-4c6fe085bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.655742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d77f0f9a-3211-4e5c-8e94-4c6fe085bdcf None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:15.657286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d77f0f9a-3211-4e5c-8e94-4c6fe085bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:15.700434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:15.703747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:15.720281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ff35e-e2ad-458a-8819-5bc327679239 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.738202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 109/218] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:15.758838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.760073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.760816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.761278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] PATH_INFO: `/v3/users/3ca636cbd9f74b84b47475ec28bbc4ba` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.761869 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f0f9a-3211-4e5c-8e94-4c6fe085bdcf None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.778636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=3ca636cbd9f74b84b47475ec28bbc4ba)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:15.780489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:15.782752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 110/219] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/users/3ca636cbd9f74b84b47475ec28bbc4ba => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:15.788420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.889767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f0f9a-3211-4e5c-8e94-4c6fe085bdcf None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.904993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab114c35-d8a2-4679-a23d-e870acc00eb0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:15.933574 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.934378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.935448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.935569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.948126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:15.948367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:15.948954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:15.949239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:15.949515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:15.956389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:15.957260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:15.958056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 110/220] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:15.965086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:15.967890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:16.009145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:16.046622 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.048375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.093437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7ec1c-2b85-4cf4-b947-837afad9797c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.138877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.139603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.139892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.140175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.141563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:16.141686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.143247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.154291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 111/221] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:16.160019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.163826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 111/222] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:16.169378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.221453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:16.282554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c8e5-0e0e-47a3-aa99-5234316950b4 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.295104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618754ca-a1ce-4b87-abfc-347bf813f7d0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.319238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48de1e-2084-428f-bae8-fa2fa3f5aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.320292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48de1e-2084-428f-bae8-fa2fa3f5aed5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.320672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48de1e-2084-428f-bae8-fa2fa3f5aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.321051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48de1e-2084-428f-bae8-fa2fa3f5aed5 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.322419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48de1e-2084-428f-bae8-fa2fa3f5aed5 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.324006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48de1e-2084-428f-bae8-fa2fa3f5aed5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.325896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 112/223] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:16.327170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebff2-4809-44bc-b1a7-7fd332a69dbd None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.331590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebff2-4809-44bc-b1a7-7fd332a69dbd None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.331718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:16.331957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebff2-4809-44bc-b1a7-7fd332a69dbd None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.333364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 113/224] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:16.334095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebff2-4809-44bc-b1a7-7fd332a69dbd None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.340178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68599141-d6bb-4c65-bdd8-b660b418798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.341739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68599141-d6bb-4c65-bdd8-b660b418798f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.342122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68599141-d6bb-4c65-bdd8-b660b418798f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.342511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68599141-d6bb-4c65-bdd8-b660b418798f None admin] PATH_INFO: `/v3/users/1af9c4275593447e9a62071eb6376a2f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.343853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68599141-d6bb-4c65-bdd8-b660b418798f None admin] RBAC: Authorizing `identity:get_user(user_id=1af9c4275593447e9a62071eb6376a2f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.345583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68599141-d6bb-4c65-bdd8-b660b418798f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.347377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 112/225] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/users/1af9c4275593447e9a62071eb6376a2f => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:16.348794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820e8bb-446e-4552-813a-2c846895a65c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.349182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820e8bb-446e-4552-813a-2c846895a65c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.349563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820e8bb-446e-4552-813a-2c846895a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.370000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3820e8bb-446e-4552-813a-2c846895a65c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:16.372377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3820e8bb-446e-4552-813a-2c846895a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:16.460541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebff2-4809-44bc-b1a7-7fd332a69dbd None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.462249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 113/226] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:16.463111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820e8bb-446e-4552-813a-2c846895a65c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.495785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:16.521315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.522230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.523236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.523719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.524740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=3ca636cbd9f74b84b47475ec28bbc4ba) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:16.525683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.528007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.536119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 114/227] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/role_assignments?user.id=3ca636cbd9f74b84b47475ec28bbc4ba&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=d38549e73a3b4007b78d77d91a93026f => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:16.537743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.616591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:16.625682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820e8bb-446e-4552-813a-2c846895a65c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.694715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.695641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.695923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.696197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.697532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.699021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.701655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 114/228] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:16.707056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.741556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e99ba3-6648-4be1-8f7c-9f92732e0896 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.784806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.785717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.786007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.786313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.796884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:16.805109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:16.806009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:16.806796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 115/229] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:16.813071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:16.845199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73675e-9de4-4e3b-97a3-1d3ec35e9511 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.855797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:16.909351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.910389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.910790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.911037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/1af9c4275593447e9a62071eb6376a2f/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.916709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0895df0c00c34b62a8aea3f9c28b1ade, user_id=1af9c4275593447e9a62071eb6376a2f, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.918304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.920020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39e2e7-ef65-4e59-b15d-2e5475c1b2c5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:16.945226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 115/230] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:16 2022] PUT /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/1af9c4275593447e9a62071eb6376a2f/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:33:16.955885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:16.956574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:16.956857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:16.957136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:16.957894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:16.958200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:16.959651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:16.973683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 116/231] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:16.975111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:17.011724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:17.122675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19e72e-e89d-4381-93cf-c33584e635a2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:17.170759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:17.171668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:17.171952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:17.172238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] PATH_INFO: `/v3/users/1af9c4275593447e9a62071eb6376a2f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:17.175902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] RBAC: Authorizing `identity:get_user(user_id=1af9c4275593447e9a62071eb6376a2f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:17.177390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:17.179264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 116/232] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:16 2022] GET /identity/v3/users/1af9c4275593447e9a62071eb6376a2f => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:17.184644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:17.292968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:17.299955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dca7b-eec8-4147-976a-0175a7ae59d5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:17.334664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fcdc-b03f-4c21-a21c-32fd71dd7018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:17.335562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fcdc-b03f-4c21-a21c-32fd71dd7018 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:17.335852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fcdc-b03f-4c21-a21c-32fd71dd7018 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:17.336131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fcdc-b03f-4c21-a21c-32fd71dd7018 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:17.337307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fcdc-b03f-4c21-a21c-32fd71dd7018 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:17.338755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fcdc-b03f-4c21-a21c-32fd71dd7018 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:17.341348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 117/233] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:17 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:17.346748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:17.506255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:17.522158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926724-3b12-4924-ae99-bc78f0ef4968 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:17.572439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3c73-d78f-4df5-8de2-be99324a51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:17.573344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3c73-d78f-4df5-8de2-be99324a51e1 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:17.573632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3c73-d78f-4df5-8de2-be99324a51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:17.573915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3c73-d78f-4df5-8de2-be99324a51e1 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/1af9c4275593447e9a62071eb6376a2f/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:17.576714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3c73-d78f-4df5-8de2-be99324a51e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0895df0c00c34b62a8aea3f9c28b1ade, user_id=1af9c4275593447e9a62071eb6376a2f, role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:17.578174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3c73-d78f-4df5-8de2-be99324a51e1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:17.606703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 117/234] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:17 2022] PUT /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/1af9c4275593447e9a62071eb6376a2f/roles/7375d2caebd143e29bfb064c04af61e7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:18.257162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f211a-647b-4612-99e0-46e0fa176aae None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.257733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f211a-647b-4612-99e0-46e0fa176aae None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.257733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f211a-647b-4612-99e0-46e0fa176aae None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.259256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 118/235] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:18.264833 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc81088-d26b-4823-b630-ad234bc88f27 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.265258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc81088-d26b-4823-b630-ad234bc88f27 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.265435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc81088-d26b-4823-b630-ad234bc88f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.287713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7dc81088-d26b-4823-b630-ad234bc88f27 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:18.288907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7dc81088-d26b-4823-b630-ad234bc88f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:18.352889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87498700-f730-4660-b654-a461ce8bf378 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.353190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87498700-f730-4660-b654-a461ce8bf378 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.353459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87498700-f730-4660-b654-a461ce8bf378 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.355079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 119/236] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:18.360443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b0dbf-b626-43e8-9276-1ed1aedff1f1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.360738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b0dbf-b626-43e8-9276-1ed1aedff1f1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.361024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b0dbf-b626-43e8-9276-1ed1aedff1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.389265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 118/237] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:18.389467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d85b0dbf-b626-43e8-9276-1ed1aedff1f1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:18.390522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d85b0dbf-b626-43e8-9276-1ed1aedff1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:18.425421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc81088-d26b-4823-b630-ad234bc88f27 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:18.518790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:18.545812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc81088-d26b-4823-b630-ad234bc88f27 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:18.546139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 120/238] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:18.582124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b0dbf-b626-43e8-9276-1ed1aedff1f1 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:18.589196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:18.590002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.590284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.591079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.601665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:18.610233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:18.611225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:18.612014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 119/239] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:18.625197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:18.759022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:18.768477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b0dbf-b626-43e8-9276-1ed1aedff1f1 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:18.801642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc056-7fc9-4400-888e-724d92f6226d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:18.831501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:18.832295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.832575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.832850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.834866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:18.836400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:18.840409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 121/240] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:18.852045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:18.852599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:18.853279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:18.853567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:18.853849 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:18.854728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:18.855048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:18.856513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:18.865440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 120/241] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:18.872875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:18.901202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:18.978674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df013e1-a213-4b49-a2d0-d48022767a50 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:18.992389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47d009-cba8-41c7-8d3f-fd1d3f326162 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:19.017427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86063217-e252-4e73-945e-719e5e604ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.018299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063217-e252-4e73-945e-719e5e604ed0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.018582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063217-e252-4e73-945e-719e5e604ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.018862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063217-e252-4e73-945e-719e5e604ed0 None admin] PATH_INFO: `/v3/users/9f1386b4808b4617ad68d64d17645243` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.027351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee167d6a-b05d-4eb7-a1b7-6cf7e5aed8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.028069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee167d6a-b05d-4eb7-a1b7-6cf7e5aed8c6 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.028365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee167d6a-b05d-4eb7-a1b7-6cf7e5aed8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.028655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee167d6a-b05d-4eb7-a1b7-6cf7e5aed8c6 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.029375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee167d6a-b05d-4eb7-a1b7-6cf7e5aed8c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:19.030832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee167d6a-b05d-4eb7-a1b7-6cf7e5aed8c6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:19.033479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86063217-e252-4e73-945e-719e5e604ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=9f1386b4808b4617ad68d64d17645243)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:19.034957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86063217-e252-4e73-945e-719e5e604ed0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:19.037161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 121/242] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:18 2022] GET /identity/v3/users/9f1386b4808b4617ad68d64d17645243 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:19.038542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2eac8-e511-4103-b6c9-1391fad1abb5 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.038827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2eac8-e511-4103-b6c9-1391fad1abb5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.039107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2eac8-e511-4103-b6c9-1391fad1abb5 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.040376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 122/243] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:19.041924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2eac8-e511-4103-b6c9-1391fad1abb5 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:19.064875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 122/244] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:18 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:19.066207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817326-3e6b-45d5-9da4-9d3e4ea6b40a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.067471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817326-3e6b-45d5-9da4-9d3e4ea6b40a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.067785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817326-3e6b-45d5-9da4-9d3e4ea6b40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.089333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d4817326-3e6b-45d5-9da4-9d3e4ea6b40a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:19.090707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d4817326-3e6b-45d5-9da4-9d3e4ea6b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:19.108372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:19.118022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:19.168402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2eac8-e511-4103-b6c9-1391fad1abb5 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:19.171889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 123/245] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:19.231623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.232327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.232622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.232903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.234974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817326-3e6b-45d5-9da4-9d3e4ea6b40a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:19.363136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:19.366694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:19.390203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817326-3e6b-45d5-9da4-9d3e4ea6b40a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:19.436237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.437292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.437715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.438170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.444219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:19.456555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:19.470751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:19.471734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:19.472624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:19.475772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 124/246] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:19.481991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:19.500876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:19.509297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 123/247] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:19.518395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:19.626320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b83254-07cf-4b0c-bbe0-610ee853b8c1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:19.648588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6db25-e9f9-4c6e-bf35-8e5bc8f27465 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:19.670671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd290d91-247a-4102-8721-255301c708bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.672004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd290d91-247a-4102-8721-255301c708bf None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.672495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd290d91-247a-4102-8721-255301c708bf None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.672973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd290d91-247a-4102-8721-255301c708bf None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.673926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd290d91-247a-4102-8721-255301c708bf None admin] RBAC: Adding query filter params (name=member) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:19.674865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd290d91-247a-4102-8721-255301c708bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:19.676818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd290d91-247a-4102-8721-255301c708bf None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:19.689416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 125/248] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:19.694675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd290d91-247a-4102-8721-255301c708bf None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:19.696097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.696984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.697274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.697558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.698828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:19.701284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:19.703128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 124/249] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:19 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:19.709100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:19.745278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:19.791136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:19.834518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d2977-57db-425d-a392-9a78d091a423 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:19.835398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd290d91-247a-4102-8721-255301c708bf None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:19.874050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea307de9-c002-4f01-8d64-9f30ef0a2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.874716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea307de9-c002-4f01-8d64-9f30ef0a2c8c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.874998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea307de9-c002-4f01-8d64-9f30ef0a2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.875315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea307de9-c002-4f01-8d64-9f30ef0a2c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.876264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea307de9-c002-4f01-8d64-9f30ef0a2c8c None admin] RBAC: Adding query filter params (role.id=382848c6a3eb409bbfb0a21dd9ed2197, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=9f1386b4808b4617ad68d64d17645243) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:19.876655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea307de9-c002-4f01-8d64-9f30ef0a2c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:19.878155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea307de9-c002-4f01-8d64-9f30ef0a2c8c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:19.885074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 125/250] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:19 2022] GET /identity/v3/role_assignments?user.id=9f1386b4808b4617ad68d64d17645243&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=382848c6a3eb409bbfb0a21dd9ed2197 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:19.886428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c982-c729-41dd-854b-9546117ed7cb None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.886719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c982-c729-41dd-854b-9546117ed7cb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.886994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c982-c729-41dd-854b-9546117ed7cb None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.892746 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:19.893330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 126/251] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:19.894335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.894777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.895291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] PATH_INFO: `/v3/users/3ca636cbd9f74b84b47475ec28bbc4ba` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.896891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] RBAC: Authorizing `identity:get_user(user_id=3ca636cbd9f74b84b47475ec28bbc4ba)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:19.897652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975f5a8-5e89-42f7-ac6f-8654b7ee9be2 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:19.898152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975f5a8-5e89-42f7-ac6f-8654b7ee9be2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:19.898621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975f5a8-5e89-42f7-ac6f-8654b7ee9be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:19.899067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:19.901426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 126/252] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:19 2022] GET /identity/v3/users/3ca636cbd9f74b84b47475ec28bbc4ba => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:19.908366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:19.930909 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b975f5a8-5e89-42f7-ac6f-8654b7ee9be2 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:19.932268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b975f5a8-5e89-42f7-ac6f-8654b7ee9be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:20.034654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cd850-835f-4d2c-83e9-17aa61bbb342 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:20.061020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 127/253] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:20.074253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:20.075944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.076376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.076797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.078150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:20.079784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:20.081969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 127/254] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:19 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:20.087498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975f5a8-5e89-42f7-ac6f-8654b7ee9be2 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:20.122751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:20.137232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:20.143226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:20.292378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975f5a8-5e89-42f7-ac6f-8654b7ee9be2 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:20.301483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a38cbe-ae3d-47a4-8033-4c54c6b8611d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:20.340000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c293-70ee-4133-9ac0-e9cd4f6d7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:20.341179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c293-70ee-4133-9ac0-e9cd4f6d7264 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.341470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c293-70ee-4133-9ac0-e9cd4f6d7264 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.341751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c293-70ee-4133-9ac0-e9cd4f6d7264 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.361275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c293-70ee-4133-9ac0-e9cd4f6d7264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d462c293-70ee-4133-9ac0-e9cd4f6d7264 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:20.372335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:20.373238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:20.374019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:20.374628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 128/255] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:20.376240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2544-0bd5-4924-9f23-cbc1e2b741d2 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.377739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c7cfa-9c26-4a95-9401-ca2c242e17cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:20.378879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c7cfa-9c26-4a95-9401-ca2c242e17cc None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.379173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c7cfa-9c26-4a95-9401-ca2c242e17cc None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.379480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c7cfa-9c26-4a95-9401-ca2c242e17cc None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/3ca636cbd9f74b84b47475ec28bbc4ba/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.381501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c7cfa-9c26-4a95-9401-ca2c242e17cc None admin] RBAC: Authorizing `identity:create_grant(project_id=0895df0c00c34b62a8aea3f9c28b1ade, user_id=3ca636cbd9f74b84b47475ec28bbc4ba, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:20.382981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c7cfa-9c26-4a95-9401-ca2c242e17cc None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:20.385257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2544-0bd5-4924-9f23-cbc1e2b741d2 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.385575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2544-0bd5-4924-9f23-cbc1e2b741d2 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.387134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 129/256] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:20.394236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2544-0bd5-4924-9f23-cbc1e2b741d2 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:20.412851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 128/257] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:20 2022] PUT /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/3ca636cbd9f74b84b47475ec28bbc4ba/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:20.414180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600ea5-060b-47de-9d37-2278a6698372 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.414482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600ea5-060b-47de-9d37-2278a6698372 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.414769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600ea5-060b-47de-9d37-2278a6698372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.463865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3e600ea5-060b-47de-9d37-2278a6698372 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:20.467086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3e600ea5-060b-47de-9d37-2278a6698372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:20.551381 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:20.614482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 129/258] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:20.619226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2544-0bd5-4924-9f23-cbc1e2b741d2 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:20.656443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:20.657104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.657403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.657697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.658470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:20.658794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:20.660274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:20.671750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 130/259] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:20.677132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600ea5-060b-47de-9d37-2278a6698372 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:20.686958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:20.702709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:20.866897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600ea5-060b-47de-9d37-2278a6698372 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:20.880702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b671-098b-47d4-ab15-5cb5d049eb56 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:20.909807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:20.910881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.911171 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.911486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] PATH_INFO: `/v3/users/1af9c4275593447e9a62071eb6376a2f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.912600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:20.913669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] RBAC: Authorizing `identity:get_user(user_id=1af9c4275593447e9a62071eb6376a2f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:20.915734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:20.917774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 130/260] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:20 2022] GET /identity/v3/users/1af9c4275593447e9a62071eb6376a2f => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:20.918861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:20.919785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:20.920140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:20.920489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:20.922844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:20.936247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:20.944913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:20.945912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:20.946750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:20.949589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 131/261] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:20.957706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:21.048660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:21.077897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e027-5b02-4c00-8055-b8e65ca785a6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:21.119699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:21.120357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:21.120639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:21.120916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:21.170283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb592-096e-4da1-833a-c67e7f8f05f3 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:21.245198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:21.246435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:21.247493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:21.247973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:21.248923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:21.249435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:21.251607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:21.267524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 132/262] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:21.273148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:21.279514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:21.281010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:21.370686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:21.472840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:21.475151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7bbf-8d13-42b5-82fa-e2e328fc1f41 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:21.522296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 131/263] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:21.530416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:21.556845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:21.557732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:21.558014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:21.558287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] PATH_INFO: `/v3/users/1af9c4275593447e9a62071eb6376a2f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:21.563934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] RBAC: Authorizing `identity:get_user(user_id=1af9c4275593447e9a62071eb6376a2f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:21.565400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:21.567459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 133/264] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:21 2022] GET /identity/v3/users/1af9c4275593447e9a62071eb6376a2f => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:21.572864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:21.720953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02887f-0e5f-4f2e-8e47-9218541eba24 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:21.742960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b611b-2219-44d1-9089-d2b32ac1cb84 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:21.775556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:21.788495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:21.789388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:21.789670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:21.789939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:21.795922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:21.797404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:21.799112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 132/265] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:21 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:21.802607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:21.803297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:21.803595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:21.803883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:21.805040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:21.904043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:21.905533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:21.930938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:22.017211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 134/266] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:22.028971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:22.057693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ae4ed-6093-44cd-ae20-560c64102859 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:22.075619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:22.121189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:22.122268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.122696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.123255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.124357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=1af9c4275593447e9a62071eb6376a2f) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:22.124819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:22.126570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:22.145594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 133/267] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:21 2022] GET /identity/v3/role_assignments?user.id=1af9c4275593447e9a62071eb6376a2f&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:22.177040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856715d-4f8b-4752-b044-177d283ab4e3 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:22.215549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d5fa3-cc1a-4925-8168-2ffdf1dabc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:22.216926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5fa3-cc1a-4925-8168-2ffdf1dabc65 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.217215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5fa3-cc1a-4925-8168-2ffdf1dabc65 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.217494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5fa3-cc1a-4925-8168-2ffdf1dabc65 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.218770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d5fa3-cc1a-4925-8168-2ffdf1dabc65 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:22.220295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d5fa3-cc1a-4925-8168-2ffdf1dabc65 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:22.222043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 135/268] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:22 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:22.227894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:22.269040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef431ec-7b97-4762-9ae5-844eae10e2e7 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.269251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef431ec-7b97-4762-9ae5-844eae10e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.269519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef431ec-7b97-4762-9ae5-844eae10e2e7 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.271246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 136/269] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:22.277703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86d9b-cb05-4a57-b836-cff874a33ae7 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.278051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86d9b-cb05-4a57-b836-cff874a33ae7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.278307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86d9b-cb05-4a57-b836-cff874a33ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.296011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b6b86d9b-cb05-4a57-b836-cff874a33ae7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:22.297233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b6b86d9b-cb05-4a57-b836-cff874a33ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:22.369292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2705-79e2-4b13-991e-08d39a180a8f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:22.377964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 137/270] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:22.391728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:22.427167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:22.427871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.428156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.428436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.429286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] RBAC: Adding query filter params (role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=1af9c4275593447e9a62071eb6376a2f) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:22.429603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:22.431065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:22.436092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b86d9b-cb05-4a57-b836-cff874a33ae7 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:22.439504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 134/271] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:22 2022] GET /identity/v3/role_assignments?user.id=1af9c4275593447e9a62071eb6376a2f&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:22.483620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:22.594738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b86d9b-cb05-4a57-b836-cff874a33ae7 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:22.639644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4841-210d-436e-a1d8-743b284ba333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:22.640493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4841-210d-436e-a1d8-743b284ba333 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.641035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4841-210d-436e-a1d8-743b284ba333 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.641316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4841-210d-436e-a1d8-743b284ba333 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.654283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4841-210d-436e-a1d8-743b284ba333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b2ec4841-210d-436e-a1d8-743b284ba333 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:22.666650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:22.667656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:22.668477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 138/272] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:22.674229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:22.791252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f17f4-5336-4349-87bf-0b2bad87091d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.791568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f17f4-5336-4349-87bf-0b2bad87091d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.791827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f17f4-5336-4349-87bf-0b2bad87091d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.793476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 139/273] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:22.798884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0dfb1-6cbb-41dd-abc2-cda8a309873a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.799177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0dfb1-6cbb-41dd-abc2-cda8a309873a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.799501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0dfb1-6cbb-41dd-abc2-cda8a309873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.814081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df1fe-a251-4516-b68c-9c30d93bcbb0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:22.821876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-88a0dfb1-6cbb-41dd-abc2-cda8a309873a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:22.823240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-88a0dfb1-6cbb-41dd-abc2-cda8a309873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:22.852691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:22.853700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:22.854202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:22.854763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:22.855743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:22.856855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:22.858484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:22.868438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 135/274] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:22.874934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:22.920859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 140/275] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:22.921613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:22.950895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0dfb1-6cbb-41dd-abc2-cda8a309873a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:22.961337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:22.989254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df5e5-7d94-499c-8e9b-b0db431a5846 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.028604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc8d9f-934f-46d8-86a9-d0366771cdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.029859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc8d9f-934f-46d8-86a9-d0366771cdaa None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.030273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc8d9f-934f-46d8-86a9-d0366771cdaa None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.030685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc8d9f-934f-46d8-86a9-d0366771cdaa None admin] PATH_INFO: `/v3/users/bddd16837e244094bf0f6195017c896f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.045362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc8d9f-934f-46d8-86a9-d0366771cdaa None admin] RBAC: Authorizing `identity:get_user(user_id=bddd16837e244094bf0f6195017c896f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:23.047065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc8d9f-934f-46d8-86a9-d0366771cdaa None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:23.049892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 136/276] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:22 2022] GET /identity/v3/users/bddd16837e244094bf0f6195017c896f => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:23.051392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe11ef-30da-4b8a-ae0f-d8538ac3e490 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.051821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe11ef-30da-4b8a-ae0f-d8538ac3e490 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.052258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe11ef-30da-4b8a-ae0f-d8538ac3e490 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.054077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 137/277] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:23.054964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe11ef-30da-4b8a-ae0f-d8538ac3e490 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.071723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0dfb1-6cbb-41dd-abc2-cda8a309873a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.109375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d39805-c53e-467a-b166-6504bc77ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.110451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39805-c53e-467a-b166-6504bc77ed31 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.111018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39805-c53e-467a-b166-6504bc77ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.111509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39805-c53e-467a-b166-6504bc77ed31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.112899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d39805-c53e-467a-b166-6504bc77ed31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:23.114538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d39805-c53e-467a-b166-6504bc77ed31 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:23.120533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 141/278] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:23.120533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4245c-7cac-494c-bcd4-52fe9d660866 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.120533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4245c-7cac-494c-bcd4-52fe9d660866 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.120533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4245c-7cac-494c-bcd4-52fe9d660866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.135662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-51a4245c-7cac-494c-bcd4-52fe9d660866 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:23.136826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-51a4245c-7cac-494c-bcd4-52fe9d660866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:23.163077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:23.172156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe11ef-30da-4b8a-ae0f-d8538ac3e490 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.208069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.208512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 142/279] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:23.209386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4245c-7cac-494c-bcd4-52fe9d660866 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.217339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.217339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.217339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.217901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:23.218658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, user.id=bddd16837e244094bf0f6195017c896f, scope.system=all) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:23.218976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:23.220446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:23.235248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 138/280] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 23 13:33:23 2022] GET /identity/v3/role_assignments?user.id=bddd16837e244094bf0f6195017c896f&scope.system=all&role.id=d38549e73a3b4007b78d77d91a93026f => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:23.237259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.332739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4245c-7cac-494c-bcd4-52fe9d660866 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.373316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a70dd-8c0c-4a47-9c41-04f62de24c89 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.376123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.377052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.377530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.378004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.378945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:23.380684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:23.409935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 143/281] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:23 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:23.425330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac98a7-71c7-40e8-8f1b-183b55867082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.426520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac98a7-71c7-40e8-8f1b-183b55867082 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.427026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac98a7-71c7-40e8-8f1b-183b55867082 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.427517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac98a7-71c7-40e8-8f1b-183b55867082 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.441562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac98a7-71c7-40e8-8f1b-183b55867082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-6eac98a7-71c7-40e8-8f1b-183b55867082 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:23.450797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:23.451814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:23.452622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:23.455580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 139/282] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:23.467101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.508391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85151-f296-4756-a98e-da5ea6259a9e None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.508612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85151-f296-4756-a98e-da5ea6259a9e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.508704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85151-f296-4756-a98e-da5ea6259a9e None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.510388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 140/283] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:23.516322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd863c-4028-4313-9402-f41f9b057f3e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.516934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd863c-4028-4313-9402-f41f9b057f3e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.517410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd863c-4028-4313-9402-f41f9b057f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.535130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f9dd863c-4028-4313-9402-f41f9b057f3e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:23.536788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f9dd863c-4028-4313-9402-f41f9b057f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:23.548064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:23.561087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:23.601444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ab27c-4966-4878-bdb0-115cb485b482 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.644037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 141/284] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:23.650133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.650806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.651091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.651396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.652147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:23.652455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:23.653848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:23.663700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 144/285] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:23.668326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd863c-4028-4313-9402-f41f9b057f3e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.673861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.816640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd863c-4028-4313-9402-f41f9b057f3e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.824358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df662579-4bf9-422e-ba14-aa1d493cb03f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:23.855466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.856837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.856943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:23.857136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.857397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.870764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:23.871025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:23.871969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:23.872255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:23.872537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] PATH_INFO: `/v3/users/9f1386b4808b4617ad68d64d17645243` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:23.873742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] RBAC: Authorizing `identity:get_user(user_id=9f1386b4808b4617ad68d64d17645243)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:23.875235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:23.877188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 145/286] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:23 2022] GET /identity/v3/users/9f1386b4808b4617ad68d64d17645243 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:23.880209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:23.881247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:23.882208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:23.884457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 142/287] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:23.889061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.890107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:23.909485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:24.008108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5111cb-e3f8-4b24-867e-a259776a1d0a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:24.046429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:24.048994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:24.050206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:24.051222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:24.054979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:24.057735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:24.062829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 146/288] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:23 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:24.068513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:24.129057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ee2d3-3030-4c22-8b31-07f8b4a3f424 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:24.174804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:24.189760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:24.190443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:24.190733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:24.191028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:24.191803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:24.192117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:24.193545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:24.213463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 143/289] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:24.219700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:24.257838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bdd1-c320-4215-b9d1-d2301c17150b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:24.323524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:24.325306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:24.325590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:24.325870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/9f1386b4808b4617ad68d64d17645243/roles/382848c6a3eb409bbfb0a21dd9ed2197` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:24.328741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:24.329918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] RBAC: Authorizing `identity:create_grant(project_id=0895df0c00c34b62a8aea3f9c28b1ade, user_id=9f1386b4808b4617ad68d64d17645243, role_id=382848c6a3eb409bbfb0a21dd9ed2197)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:24.331314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:24.369329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edecd3a-702a-42ef-8fbb-c759a21b6eae None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:24.373471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 147/290] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:33:24 2022] PUT /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/users/9f1386b4808b4617ad68d64d17645243/roles/382848c6a3eb409bbfb0a21dd9ed2197 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:33:24.419557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:24.421236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:24.421737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:24.422223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] PATH_INFO: `/v3/users/3ca636cbd9f74b84b47475ec28bbc4ba` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:24.423912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] RBAC: Authorizing `identity:get_user(user_id=3ca636cbd9f74b84b47475ec28bbc4ba)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:24.425827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:24.428331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 144/291] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:24 2022] GET /identity/v3/users/3ca636cbd9f74b84b47475ec28bbc4ba => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:24.433616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:24.613830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985106b-0376-4003-a66b-a2427be5831a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:24.635164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:24.652078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:24.652723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:24.653524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:24.653806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:24.729987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:24.731960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:24.865780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 148/292] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:24.870933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:25.009892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f14a-b23e-4503-949f-2432550a028a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:25.050830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e0dca-4728-4c9b-b27b-5903469aee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:25.051747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0dca-4728-4c9b-b27b-5903469aee2c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.052081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0dca-4728-4c9b-b27b-5903469aee2c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.052451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0dca-4728-4c9b-b27b-5903469aee2c None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.053682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e0dca-4728-4c9b-b27b-5903469aee2c None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:25.055158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e0dca-4728-4c9b-b27b-5903469aee2c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:25.057093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 145/293] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:24 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:25.063287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:25.108102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:25.272528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf710ff-fc71-4e72-a3fa-49db25b146a4 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:25.321826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecdd6-922c-4f2b-9954-3356fadce803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:25.322498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecdd6-922c-4f2b-9954-3356fadce803 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.322790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecdd6-922c-4f2b-9954-3356fadce803 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.323074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecdd6-922c-4f2b-9954-3356fadce803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.323945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fecdd6-922c-4f2b-9954-3356fadce803 None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=3ca636cbd9f74b84b47475ec28bbc4ba) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:25.324262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fecdd6-922c-4f2b-9954-3356fadce803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:25.326243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fecdd6-922c-4f2b-9954-3356fadce803 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:25.333048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 149/294] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:25 2022] GET /identity/v3/role_assignments?user.id=3ca636cbd9f74b84b47475ec28bbc4ba&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=d38549e73a3b4007b78d77d91a93026f => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:25.380189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311578ef-e196-42fe-b7ec-c0f9041b683d None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.380477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311578ef-e196-42fe-b7ec-c0f9041b683d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.380752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311578ef-e196-42fe-b7ec-c0f9041b683d None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.382481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 146/295] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:25.388832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5dd08-9cc0-41e1-ad26-40d96dd28a5a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.389135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5dd08-9cc0-41e1-ad26-40d96dd28a5a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.389412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5dd08-9cc0-41e1-ad26-40d96dd28a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.407464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-90e5dd08-9cc0-41e1-ad26-40d96dd28a5a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:25.408676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-90e5dd08-9cc0-41e1-ad26-40d96dd28a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:25.491474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 150/296] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:25.514187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311578ef-e196-42fe-b7ec-c0f9041b683d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:25.531431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:25.646908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311578ef-e196-42fe-b7ec-c0f9041b683d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:25.681769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:25.682567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.682850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.683125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.694782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:25.703390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:25.704253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:25.705500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 147/297] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:25.710976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5dd08-9cc0-41e1-ad26-40d96dd28a5a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:25.734246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:25.840963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5dd08-9cc0-41e1-ad26-40d96dd28a5a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:25.877851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:25.878891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:25.879416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:25.879885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:25.880838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:25.881350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:25.884416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:25.895372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 151/298] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:25.900621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:25.976744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:26.011801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f1d5f-b86e-4e8a-91cd-eb284e61ca4c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:26.047926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24255c-175d-4c85-9817-fbc38f8a4143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:26.048808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24255c-175d-4c85-9817-fbc38f8a4143 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.049099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24255c-175d-4c85-9817-fbc38f8a4143 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.049379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24255c-175d-4c85-9817-fbc38f8a4143 None admin] PATH_INFO: `/v3/users/bddd16837e244094bf0f6195017c896f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.050581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24255c-175d-4c85-9817-fbc38f8a4143 None admin] RBAC: Authorizing `identity:get_user(user_id=bddd16837e244094bf0f6195017c896f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:26.052086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24255c-175d-4c85-9817-fbc38f8a4143 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:26.054026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 148/299] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:25 2022] GET /identity/v3/users/bddd16837e244094bf0f6195017c896f => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:26.059890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:26.138545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:26.161547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb15c77-8d00-427d-9e6d-890b65d2e9c1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:26.171279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712667-c17d-41fe-9ddf-a6c25111c589 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.171568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712667-c17d-41fe-9ddf-a6c25111c589 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.171848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712667-c17d-41fe-9ddf-a6c25111c589 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.173473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 149/300] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:26.178349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f595e38-0b83-4364-8280-15645e2417cb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.178641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f595e38-0b83-4364-8280-15645e2417cb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.178924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f595e38-0b83-4364-8280-15645e2417cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.196250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556d54e-e55a-4128-bb4d-b1464660b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:26.197123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d54e-e55a-4128-bb4d-b1464660b69f None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.197406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d54e-e55a-4128-bb4d-b1464660b69f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.197681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d54e-e55a-4128-bb4d-b1464660b69f None admin] PATH_INFO: `/v3/system/users/bddd16837e244094bf0f6195017c896f/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.198960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2f595e38-0b83-4364-8280-15645e2417cb None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:26.199162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556d54e-e55a-4128-bb4d-b1464660b69f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bddd16837e244094bf0f6195017c896f, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:26.201067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2f595e38-0b83-4364-8280-15645e2417cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:26.201596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556d54e-e55a-4128-bb4d-b1464660b69f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:26.211908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 152/301] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Jun 23 13:33:26 2022] PUT /identity/v3/system/users/bddd16837e244094bf0f6195017c896f/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:26.294485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402a9e2-2a75-48b3-9a93-1a9c2d76d55a None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.295168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402a9e2-2a75-48b3-9a93-1a9c2d76d55a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.295702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402a9e2-2a75-48b3-9a93-1a9c2d76d55a None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.297699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 153/302] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:26.301838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 150/303] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:26.303489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117e18a-8d08-41de-81c3-7cba5662c968 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.303860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117e18a-8d08-41de-81c3-7cba5662c968 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.304217 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117e18a-8d08-41de-81c3-7cba5662c968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.322543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9117e18a-8d08-41de-81c3-7cba5662c968 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:26.323964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9117e18a-8d08-41de-81c3-7cba5662c968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:26.327038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f595e38-0b83-4364-8280-15645e2417cb None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:26.404431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:26.413810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 154/304] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:26.438150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117e18a-8d08-41de-81c3-7cba5662c968 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:26.447986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f595e38-0b83-4364-8280-15645e2417cb None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:26.484097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:26.485352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.485736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.486110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.488103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:26.489029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:26.490750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 151/305] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:26.500045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:26.525635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:26.562962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117e18a-8d08-41de-81c3-7cba5662c968 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:26.598705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:26.599768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.600202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.600659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.602061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bfe7b-6755-4816-86b9-82ea2b9749e6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:26.612471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:26.620446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:26.622197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:26.623228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:26.630020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 155/306] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:26.631109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:26.641151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828216c-7fbb-4bdf-a047-0e6d27c34b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:26.641648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828216c-7fbb-4bdf-a047-0e6d27c34b07 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.642012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828216c-7fbb-4bdf-a047-0e6d27c34b07 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.642380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828216c-7fbb-4bdf-a047-0e6d27c34b07 None admin] PATH_INFO: `/v3/groups` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.643155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828216c-7fbb-4bdf-a047-0e6d27c34b07 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:26.644722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828216c-7fbb-4bdf-a047-0e6d27c34b07 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:26.647792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:26.670022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 152/307] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Jun 23 13:33:26 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:26.752179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94226-730b-4530-9944-eb52a855dbc7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:26.781516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e6f7-4294-4402-9a07-5f615fa28810 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.781884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e6f7-4294-4402-9a07-5f615fa28810 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.782291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e6f7-4294-4402-9a07-5f615fa28810 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.784118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 153/308] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:26.787184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:26.790000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1571-730c-4668-b19e-4e017ec9f174 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.790972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1571-730c-4668-b19e-4e017ec9f174 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.791609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1571-730c-4668-b19e-4e017ec9f174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.793896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:26.794556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.795228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.795546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.796727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:26.797033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:26.798477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:26.808177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 156/309] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:26.814303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:26.814812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a5cb1571-730c-4668-b19e-4e017ec9f174 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:26.816332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a5cb1571-730c-4668-b19e-4e017ec9f174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:26.895417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 154/310] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:26.918224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb1571-730c-4668-b19e-4e017ec9f174 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:26.937058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f2c02-f62e-4765-8e09-f11e0990d9f2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:26.975536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:26.976830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:26.977470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:26.977949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] PATH_INFO: `/v3/users/529f4eb248354368aeee2250085eebca` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:26.992976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] RBAC: Authorizing `identity:get_user(user_id=529f4eb248354368aeee2250085eebca)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:26.994794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:26.997797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 157/311] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:26 2022] GET /identity/v3/users/529f4eb248354368aeee2250085eebca => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:27.004890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:27.056871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb1571-730c-4668-b19e-4e017ec9f174 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:27.062394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:27.090820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:27.105519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:27.106747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.107037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.107354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.120836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:27.123564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb07b-a01c-4117-9d20-9c3e38a120d2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:27.130352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:27.131290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:27.132100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 155/312] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:27.140197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:27.169995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:27.170830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.171123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.171428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.172594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] RBAC: Adding query filter params (role.id=382848c6a3eb409bbfb0a21dd9ed2197, user.id=529f4eb248354368aeee2250085eebca, scope.system=all) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:27.172913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:27.174763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:27.187389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 158/313] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 23 13:33:27 2022] GET /identity/v3/role_assignments?user.id=529f4eb248354368aeee2250085eebca&scope.system=all&role.id=382848c6a3eb409bbfb0a21dd9ed2197 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:27.260394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3972f14-e6f0-4090-bc47-0811e23801fd None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:27.299415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:27.300485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.300977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.301457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.302458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] RBAC: Adding query filter params (name=reader) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:27.302972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:27.304629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:27.315428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 156/314] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:27.321446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:27.431181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5d9e-7228-4579-94e6-5c462ad8362a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:27.447231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:27.473909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:27.475146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.475669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.476172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] PATH_INFO: `/v3/users/9f1386b4808b4617ad68d64d17645243` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.477775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] RBAC: Authorizing `identity:get_user(user_id=9f1386b4808b4617ad68d64d17645243)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:27.479484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:27.482228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 159/315] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:27 2022] GET /identity/v3/users/9f1386b4808b4617ad68d64d17645243 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:27.487962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:27.540024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:27.595402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b2fd4-3c5a-4dc1-81fd-66ee286282af None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:27.630053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:27.630717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.631006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.631317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.701813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:27.703647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:27.751637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:27.810814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 157/316] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:27.816107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:27.923669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc4c0-27a5-4bab-8a18-e8562ebdc587 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:27.959168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3701a05-e943-4c49-bcd3-8c7c31699e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:27.959992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3701a05-e943-4c49-bcd3-8c7c31699e9c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:27.960282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3701a05-e943-4c49-bcd3-8c7c31699e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:27.960567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3701a05-e943-4c49-bcd3-8c7c31699e9c None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:27.961762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3701a05-e943-4c49-bcd3-8c7c31699e9c None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:27.963236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3701a05-e943-4c49-bcd3-8c7c31699e9c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:27.965274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 160/317] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:27 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:27.971080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:28.076092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d55aa-2e3d-4a18-9579-1358212c45cd None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:28.111231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72bc48-04ad-4a01-9b51-6483e496cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:28.112206 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72bc48-04ad-4a01-9b51-6483e496cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.112689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72bc48-04ad-4a01-9b51-6483e496cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.113183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72bc48-04ad-4a01-9b51-6483e496cdc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.114236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72bc48-04ad-4a01-9b51-6483e496cdc9 None admin] RBAC: Adding query filter params (role.id=382848c6a3eb409bbfb0a21dd9ed2197, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade, user.id=9f1386b4808b4617ad68d64d17645243) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:28.114745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72bc48-04ad-4a01-9b51-6483e496cdc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:28.116404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72bc48-04ad-4a01-9b51-6483e496cdc9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:28.123139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 158/318] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:27 2022] GET /identity/v3/role_assignments?user.id=9f1386b4808b4617ad68d64d17645243&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=382848c6a3eb409bbfb0a21dd9ed2197 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:28.351855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38322f3b-5e0c-4d0d-9a9a-fdc7cdef5b48 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.352243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38322f3b-5e0c-4d0d-9a9a-fdc7cdef5b48 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.352419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38322f3b-5e0c-4d0d-9a9a-fdc7cdef5b48 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.354096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 161/319] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:28.359361 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930aa2d-5dd6-42dd-b752-81d9fe305647 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.359752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930aa2d-5dd6-42dd-b752-81d9fe305647 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.360106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930aa2d-5dd6-42dd-b752-81d9fe305647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.377486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a930aa2d-5dd6-42dd-b752-81d9fe305647 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:28.378674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a930aa2d-5dd6-42dd-b752-81d9fe305647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:28.382367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:28.452134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 159/320] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:28.475184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38322f3b-5e0c-4d0d-9a9a-fdc7cdef5b48 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:28.533021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:28.585169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38322f3b-5e0c-4d0d-9a9a-fdc7cdef5b48 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:28.618436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:28.619230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.619530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.619851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.630435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:28.638775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:28.639867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:28.640668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:28.642060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 162/321] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:28.646112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930aa2d-5dd6-42dd-b752-81d9fe305647 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:28.745550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930aa2d-5dd6-42dd-b752-81d9fe305647 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:28.780206 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a983ead-ad98-44a4-880b-f0e1a1526d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:28.780876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a983ead-ad98-44a4-880b-f0e1a1526d55 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.781161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a983ead-ad98-44a4-880b-f0e1a1526d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.781437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a983ead-ad98-44a4-880b-f0e1a1526d55 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.782184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a983ead-ad98-44a4-880b-f0e1a1526d55 None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:28.782492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a983ead-ad98-44a4-880b-f0e1a1526d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:28.783915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a983ead-ad98-44a4-880b-f0e1a1526d55 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:28.796798 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 160/322] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:28.798002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:28.799807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7621a1-4711-40bd-a741-2ea8edf52d12 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.800107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7621a1-4711-40bd-a741-2ea8edf52d12 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.800400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7621a1-4711-40bd-a741-2ea8edf52d12 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.801736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 161/323] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:28.806514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0b8c-2da4-4455-998c-8eab8eca22a1 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.806802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0b8c-2da4-4455-998c-8eab8eca22a1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.807084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0b8c-2da4-4455-998c-8eab8eca22a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.812563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:28.824233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-863d0b8c-2da4-4455-998c-8eab8eca22a1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:28.825561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-863d0b8c-2da4-4455-998c-8eab8eca22a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:28.894178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 162/324] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:28.903172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153bef-0075-4539-b687-c335da39bc19 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:28.913880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:28.916077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d0b8c-2da4-4455-998c-8eab8eca22a1 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:28.942697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:28.943998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:28.944465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:28.944922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] PATH_INFO: `/v3/users/bddd16837e244094bf0f6195017c896f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:28.946447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] RBAC: Authorizing `identity:get_user(user_id=bddd16837e244094bf0f6195017c896f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:28.948119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:28.954903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 163/325] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:28 2022] GET /identity/v3/users/bddd16837e244094bf0f6195017c896f => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:28.955915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:29.013532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d0b8c-2da4-4455-998c-8eab8eca22a1 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:29.044963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:29.051537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:29.052331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.052614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.052891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.054030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:29.055495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:29.057240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 163/326] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:29.059998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c8b76-50dc-45d8-b89a-5be04e36b267 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:29.062338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:29.094660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf086b-d21f-480b-b7d1-aff80af0694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:29.095590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf086b-d21f-480b-b7d1-aff80af0694c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.096050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf086b-d21f-480b-b7d1-aff80af0694c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.096481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf086b-d21f-480b-b7d1-aff80af0694c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.097328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf086b-d21f-480b-b7d1-aff80af0694c None admin] RBAC: Adding query filter params (role.id=d38549e73a3b4007b78d77d91a93026f, user.id=bddd16837e244094bf0f6195017c896f, scope.system=all) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:29.097644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf086b-d21f-480b-b7d1-aff80af0694c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:29.099084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf086b-d21f-480b-b7d1-aff80af0694c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:29.111897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 164/327] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 23 13:33:28 2022] GET /identity/v3/role_assignments?user.id=bddd16837e244094bf0f6195017c896f&scope.system=all&role.id=d38549e73a3b4007b78d77d91a93026f => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:29.165374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e241-8e4a-4ce1-92ad-01c8b27398d0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:29.206001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ce873-bdac-4594-9b02-706ffa34ccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:29.206681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ce873-bdac-4594-9b02-706ffa34ccaa None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.206961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ce873-bdac-4594-9b02-706ffa34ccaa None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.207268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ce873-bdac-4594-9b02-706ffa34ccaa None admin] PATH_INFO: `/v3/groups` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.207968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ce873-bdac-4594-9b02-706ffa34ccaa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:29.209422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ce873-bdac-4594-9b02-706ffa34ccaa None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:29.225219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 164/328] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Jun 23 13:33:29 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:33:29.338045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41c9c-812a-4916-837f-827c5a37c811 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.338334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41c9c-812a-4916-837f-827c5a37c811 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.338611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41c9c-812a-4916-837f-827c5a37c811 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.340045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 165/329] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:29.346306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e351a-b6b3-4070-8fc0-ef7184b3b4d6 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.346634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e351a-b6b3-4070-8fc0-ef7184b3b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.346918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e351a-b6b3-4070-8fc0-ef7184b3b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.364811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-413e351a-b6b3-4070-8fc0-ef7184b3b4d6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:29.366032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-413e351a-b6b3-4070-8fc0-ef7184b3b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:29.424315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:29.436662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 165/330] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:29.459565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41c9c-812a-4916-837f-827c5a37c811 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:29.502391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:29.576180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41c9c-812a-4916-837f-827c5a37c811 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:29.611623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:29.612479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.612767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.613045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.624385 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:29.632058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:29.632977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:29.633777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 166/331] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:29.639340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e351a-b6b3-4070-8fc0-ef7184b3b4d6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:29.754278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e351a-b6b3-4070-8fc0-ef7184b3b4d6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:29.794257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:29.794936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.795230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.795517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.796275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:29.796580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:29.798002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:29.807193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 166/332] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:29.813349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:29.918619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:29.929257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d356b-a49b-4e09-93b6-1a1e5b492983 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:29.971648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f795b-a1a9-4276-8d2d-6923435ebe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:29.972528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f795b-a1a9-4276-8d2d-6923435ebe5c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:29.972810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f795b-a1a9-4276-8d2d-6923435ebe5c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:29.973085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f795b-a1a9-4276-8d2d-6923435ebe5c None admin] PATH_INFO: `/v3/users/529f4eb248354368aeee2250085eebca` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:29.974331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f795b-a1a9-4276-8d2d-6923435ebe5c None admin] RBAC: Authorizing `identity:get_user(user_id=529f4eb248354368aeee2250085eebca)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:29.975872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f795b-a1a9-4276-8d2d-6923435ebe5c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:29.977847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 167/333] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:29 2022] GET /identity/v3/users/529f4eb248354368aeee2250085eebca => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:29.983037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:30.046847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:30.101857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c6dd-047c-42df-8b87-4e235f019f15 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:30.138865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec756b-8b77-4f8e-8985-e3178f56f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:30.139778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec756b-8b77-4f8e-8985-e3178f56f23d None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:30.140059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec756b-8b77-4f8e-8985-e3178f56f23d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:30.140332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec756b-8b77-4f8e-8985-e3178f56f23d None admin] PATH_INFO: `/v3/system/users/529f4eb248354368aeee2250085eebca/roles/382848c6a3eb409bbfb0a21dd9ed2197` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:30.142088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec756b-8b77-4f8e-8985-e3178f56f23d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=529f4eb248354368aeee2250085eebca, role_id=382848c6a3eb409bbfb0a21dd9ed2197)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:30.143497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec756b-8b77-4f8e-8985-e3178f56f23d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:30.157131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 167/334] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Jun 23 13:33:29 2022] PUT /identity/v3/system/users/529f4eb248354368aeee2250085eebca/roles/382848c6a3eb409bbfb0a21dd9ed2197 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:33:31.717677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205536d-cea8-421b-a56e-3d052e7dff15 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:31.718226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205536d-cea8-421b-a56e-3d052e7dff15 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:31.718497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205536d-cea8-421b-a56e-3d052e7dff15 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:31.720279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 168/335] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:31.725308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503389f-281b-483e-b3e6-9b9013e5b919 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:31.725817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503389f-281b-483e-b3e6-9b9013e5b919 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:31.726016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503389f-281b-483e-b3e6-9b9013e5b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:31.748302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d503389f-281b-483e-b3e6-9b9013e5b919 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:31.749436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d503389f-281b-483e-b3e6-9b9013e5b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:31.834928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 168/336] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:31.875949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205536d-cea8-421b-a56e-3d052e7dff15 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:31.997475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205536d-cea8-421b-a56e-3d052e7dff15 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:32.036796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:32.037508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.037786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.038057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.054297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:32.062197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:32.063095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:32.063948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:32.067330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 169/337] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:32.069390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503389f-281b-483e-b3e6-9b9013e5b919 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:32.128651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:32.184244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503389f-281b-483e-b3e6-9b9013e5b919 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:32.224231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706014a-3a29-4ae9-95d3-868519763f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:32.224965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706014a-3a29-4ae9-95d3-868519763f10 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.225257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706014a-3a29-4ae9-95d3-868519763f10 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.225577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706014a-3a29-4ae9-95d3-868519763f10 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.226337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706014a-3a29-4ae9-95d3-868519763f10 None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:32.226644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706014a-3a29-4ae9-95d3-868519763f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:32.228139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706014a-3a29-4ae9-95d3-868519763f10 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:32.238048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 169/338] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:32.243244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:32.273642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:32.313443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04e00-1fac-45c8-aa0d-b2c41fd8ffcd None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.313754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04e00-1fac-45c8-aa0d-b2c41fd8ffcd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.313998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04e00-1fac-45c8-aa0d-b2c41fd8ffcd None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.315391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 170/339] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:32.320571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521f8e-11a1-4ba3-8911-ddd42c9132ff None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.320855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521f8e-11a1-4ba3-8911-ddd42c9132ff None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.321131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521f8e-11a1-4ba3-8911-ddd42c9132ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.342820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f0521f8e-11a1-4ba3-8911-ddd42c9132ff None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:32.344040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f0521f8e-11a1-4ba3-8911-ddd42c9132ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:32.403403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9984-2d61-415e-8198-b8c6e1bd5a61 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:32.460731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 171/340] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:32.462066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfb3d-80af-403d-b55d-de09281cddac None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.462358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfb3d-80af-403d-b55d-de09281cddac None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.465305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfb3d-80af-403d-b55d-de09281cddac None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.465305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 172/341] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:32.469599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cb297-003a-487f-99a0-f59c9a3d48b1 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.469927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cb297-003a-487f-99a0-f59c9a3d48b1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.470210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cb297-003a-487f-99a0-f59c9a3d48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.475897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:32.476575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.476871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.477271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.490860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b82cb297-003a-487f-99a0-f59c9a3d48b1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:32.492106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b82cb297-003a-487f-99a0-f59c9a3d48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:32.525943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:32.571489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 173/342] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:32.572579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cb297-003a-487f-99a0-f59c9a3d48b1 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:32.626643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:32.628276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:32.671733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:32.696394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cb297-003a-487f-99a0-f59c9a3d48b1 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:32.732090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:32.733592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.734023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.734446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.745226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:32.753694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:32.754777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:32.755778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:32.758065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 174/343] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:32.759102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:32.788693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:32.820150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 170/344] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:32.821837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:32.922929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e5b04-2a7f-4f7c-a647-8a3dc2216736 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:32.943719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6ba2-cfcb-4442-9173-f2a1c6bfaca6 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:32.971619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:32.982916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:32.983917 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.984388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.984844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.985767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:32.987395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:32.988985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:32.996174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:32.997970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:32.998420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:32.998855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:32.999842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 171/345] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:33.001511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.024634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:33.034855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:33.036000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:33.036897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:33.039550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 175/346] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:33.040540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.152250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc3a58-2a32-4b81-87e4-f2a0f1ab39f9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:33.159745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:33.178775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6951a-0d0f-4295-819d-c18d86b17acf None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:33.196944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:33.198770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.199293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.200454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.202436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:33.204320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:33.207466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 172/347] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:33.214164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.227037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6329-ac0a-48dc-a37a-759147fcb44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:33.227037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6329-ac0a-48dc-a37a-759147fcb44c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.227338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6329-ac0a-48dc-a37a-759147fcb44c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.227607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6329-ac0a-48dc-a37a-759147fcb44c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.289198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:33.322582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa6329-ac0a-48dc-a37a-759147fcb44c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:33.324100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa6329-ac0a-48dc-a37a-759147fcb44c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:33.347723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb269-831e-4136-918b-40ea145486a7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:33.398352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7978e75-27ea-4260-a0ba-f241c1299cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:33.399028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978e75-27ea-4260-a0ba-f241c1299cbc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.400183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978e75-27ea-4260-a0ba-f241c1299cbc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.400183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978e75-27ea-4260-a0ba-f241c1299cbc None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.400373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7978e75-27ea-4260-a0ba-f241c1299cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:33.400659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7978e75-27ea-4260-a0ba-f241c1299cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:33.403383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7978e75-27ea-4260-a0ba-f241c1299cbc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:33.412501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 173/348] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:33.413804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ace2-94f0-485d-aad7-5b950e562a5b None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.414101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ace2-94f0-485d-aad7-5b950e562a5b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.414388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ace2-94f0-485d-aad7-5b950e562a5b None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.415994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 174/349] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:33.416761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710ace2-94f0-485d-aad7-5b950e562a5b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.438596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:33.459198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 176/350] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:33.461050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b7a60-51c3-4ece-8793-5d8f8f2fe77d None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.461347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b7a60-51c3-4ece-8793-5d8f8f2fe77d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.461627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b7a60-51c3-4ece-8793-5d8f8f2fe77d None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.463285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 177/351] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:33.464273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c797-6d83-4291-97d2-8de9de627ce0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.464557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c797-6d83-4291-97d2-8de9de627ce0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.464831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c797-6d83-4291-97d2-8de9de627ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.485707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0ce8c797-6d83-4291-97d2-8de9de627ce0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:33.486929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0ce8c797-6d83-4291-97d2-8de9de627ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:33.566795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710ace2-94f0-485d-aad7-5b950e562a5b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:33.571316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 178/352] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:33.572184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8c797-6d83-4291-97d2-8de9de627ce0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.595388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:33.604587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:33.618067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.618357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.618641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.627384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:33.630008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:33.632625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 175/353] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:33.634453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.704305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8c797-6d83-4291-97d2-8de9de627ce0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:33.729159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:33.747778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:33.749246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.749536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.751332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.775607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0b1ae-1554-4f45-8ee0-413ae8d81452 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:33.823428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329625e-c284-4b36-8334-0fe9c9b4dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:33.823428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329625e-c284-4b36-8334-0fe9c9b4dd64 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.824141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329625e-c284-4b36-8334-0fe9c9b4dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.824141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329625e-c284-4b36-8334-0fe9c9b4dd64 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.825576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329625e-c284-4b36-8334-0fe9c9b4dd64 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:33.827019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329625e-c284-4b36-8334-0fe9c9b4dd64 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:33.829099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 176/354] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:33.830888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbbb58-8091-4f24-9074-9a1683690817 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:33.831448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbbb58-8091-4f24-9074-9a1683690817 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:33.831934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbbb58-8091-4f24-9074-9a1683690817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:33.841372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:33.843160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:33.852496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-13cbbb58-8091-4f24-9074-9a1683690817 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:33.853709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-13cbbb58-8091-4f24-9074-9a1683690817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:33.916510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:33.948667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 177/355] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:33.949540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbbb58-8091-4f24-9074-9a1683690817 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.971296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 179/356] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:33.972399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:33.993371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.084488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbbb58-8091-4f24-9074-9a1683690817 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.095284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005db66-a087-4837-9217-7b8404f5bb40 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.125194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bced7c-6d0b-4e76-a1cd-a4f697013776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.126003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bced7c-6d0b-4e76-a1cd-a4f697013776 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.126291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bced7c-6d0b-4e76-a1cd-a4f697013776 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.126573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bced7c-6d0b-4e76-a1cd-a4f697013776 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.141279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.141736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bced7c-6d0b-4e76-a1cd-a4f697013776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:34.141946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.142237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.142520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.143404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=5ee573fc7a3445568d49498c20f3ed88) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:34.143726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:34.145184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-f4bced7c-6d0b-4e76-a1cd-a4f697013776 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:34.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:34.150641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 13:33:34.151680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:34.152308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 180/357] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=d38549e73a3b4007b78d77d91a93026f => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:34.152308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.154313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 178/358] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:34.155825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c731c25-2243-4be8-abbb-9cc3c56049b5 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.156264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c731c25-2243-4be8-abbb-9cc3c56049b5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.156686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c731c25-2243-4be8-abbb-9cc3c56049b5 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.158079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 179/359] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:34.159053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c731c25-2243-4be8-abbb-9cc3c56049b5 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.222055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.275834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.304322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb3e1e-7952-42c2-88b3-478b926544c9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.313845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c731c25-2243-4be8-abbb-9cc3c56049b5 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.351311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.352736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.352736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.352736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.356008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:34.357599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:34.359906 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 181/360] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:34.360695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.367061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c7578-ccb0-442e-9493-ccd50e9ef6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.367963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7578-ccb0-442e-9493-ccd50e9ef6d7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.368252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7578-ccb0-442e-9493-ccd50e9ef6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.368535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c7578-ccb0-442e-9493-ccd50e9ef6d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.384707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c7578-ccb0-442e-9493-ccd50e9ef6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-fa6c7578-ccb0-442e-9493-ccd50e9ef6d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:34.394846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:34.396052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:34.397131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 180/361] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:34.397940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8ebc1-81ba-44c0-af68-5729176d7659 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.397940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8ebc1-81ba-44c0-af68-5729176d7659 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.398132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8ebc1-81ba-44c0-af68-5729176d7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.422799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-07b8ebc1-81ba-44c0-af68-5729176d7659 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:34.424266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-07b8ebc1-81ba-44c0-af68-5729176d7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:34.507858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187465ee-0f98-4b68-a693-dbf34eaef4ad None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.510881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 181/362] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:34.512023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8ebc1-81ba-44c0-af68-5729176d7659 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.549540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.550404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.550692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.550970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.551161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.552485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:34.554017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:34.560410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 182/363] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:34.560410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.582685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.651674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8ebc1-81ba-44c0-af68-5729176d7659 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.701689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23dfa8-199f-4602-b501-78a38e618857 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.701886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.702451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.702742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.703028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.703836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:34.704303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:34.705852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:34.718390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 182/364] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:34.719049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.756151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.756882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.757178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.757459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.758293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:34.758612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:34.761091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:34.767350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 183/365] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=d38549e73a3b4007b78d77d91a93026f => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:34.768303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.852334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.868703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b75b5-38d6-46a1-908f-99c8fa1bf47c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.888087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:34.911148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8b397-9d88-4205-a535-05ae53970480 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:34.930524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.931251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.931548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.931826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.932758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:34.933219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:34.935527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:34.946907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 183/366] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:34.952453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:34.958397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:34.959634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:34.959634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:34.959859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:34.974742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:34.983763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:34.984692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:34.985524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 184/367] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:34.986200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:35.089885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d858f-29a4-4f4f-9ddf-60af45b9483d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:35.106931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a9a8-c6a0-4267-b044-7ad2a5343d7f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:35.133404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:35.135226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:35.135725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:35.136357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:35.138390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:35.140712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:35.143223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 184/368] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:35.144162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:35.149255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:35.150260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:35.150618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:35.151007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] PATH_INFO: `/v3/users/529f4eb248354368aeee2250085eebca` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:35.153834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] RBAC: Authorizing `identity:get_user(user_id=529f4eb248354368aeee2250085eebca)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:35.155548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:35.157672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 185/369] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:33:34 2022] GET /identity/v3/users/529f4eb248354368aeee2250085eebca => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:35.158478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:35.176325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:35.182928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:35.285691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83bbb8-b65f-4fb4-b960-0b577b6cf9d1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:35.304927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc3a44-ab40-4f0d-9675-93f996aaa5b6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:35.325050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:35.325715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:35.326010 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:35.326300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:35.343509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:35.344524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:35.345032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:35.347712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:35.348754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:35.349279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:35.350893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:35.361387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 186/370] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:35.362541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:35.428869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:35.430864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:35.455113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:35.460428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:35.505025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5deab0-eef7-45a4-8ef5-c691a3ba18b6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:35.562146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:35.563502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:35.563978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:35.564437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:35.565451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=5ee573fc7a3445568d49498c20f3ed88) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:35.565950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:35.567596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:35.574832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 187/371] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:35 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:35.576451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:35.588661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 185/372] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:35.589534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:35.764276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d70807-575d-4d3a-91e7-4393b0b45953 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:35.840382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed74c-94fa-4919-9b51-dc5506146694 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:35.846002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:35.846680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:35.846972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:35.847289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:35.848141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] RBAC: Adding query filter params (role.id=382848c6a3eb409bbfb0a21dd9ed2197, user.id=529f4eb248354368aeee2250085eebca, scope.system=all) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:35.848464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:35.856908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:35.862285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:35.881106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 188/373] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 23 13:33:35 2022] GET /identity/v3/role_assignments?user.id=529f4eb248354368aeee2250085eebca&scope.system=all&role.id=382848c6a3eb409bbfb0a21dd9ed2197 => generated 510 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:35.881715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:35.892762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:35.933683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:35.939235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:35.939235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:35.939235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.122353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:36.126884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:36.175231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeff6-5a03-4011-a43a-a3941db0e03d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:36.220628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:36.221512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.221809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.222089 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.223693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:36.225173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:36.227165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 189/374] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:35 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:36.236197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:36.335047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:36.383069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a2cd3-3d84-4a09-b5aa-6f4c9ab69e32 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:36.423115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:36.424015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.424308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.424589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.425787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:36.427269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:36.428895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 190/375] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:36 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:36.436121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:36.440931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 186/376] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:36.446409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:36.475914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:36.585763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc1fa-cfb4-4d39-9952-1a19b79a2a7f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:36.612655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa91dd-b451-4cc4-87f7-782a8af20bf1 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:36.645182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44810b-7096-41fe-b145-63fcf2b3b98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:36.645973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44810b-7096-41fe-b145-63fcf2b3b98a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.646264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44810b-7096-41fe-b145-63fcf2b3b98a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.646543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44810b-7096-41fe-b145-63fcf2b3b98a None admin] PATH_INFO: `/v3/projects/4822884e35e54aa6816f97330f3285a9` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.648479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44810b-7096-41fe-b145-63fcf2b3b98a None admin] RBAC: Authorizing `identity:get_project(project_id=4822884e35e54aa6816f97330f3285a9)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:36.650129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44810b-7096-41fe-b145-63fcf2b3b98a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:36.652298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 187/377] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:36 2022] GET /identity/v3/projects/4822884e35e54aa6816f97330f3285a9 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:36.653418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:36.655708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d22e-da74-4efc-a01c-c684e48317e5 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.656466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d22e-da74-4efc-a01c-c684e48317e5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.656929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d22e-da74-4efc-a01c-c684e48317e5 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.659781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852d4f0-89b2-45c3-8575-e50d5eff1762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:36.659979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 188/378] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:36.660437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852d4f0-89b2-45c3-8575-e50d5eff1762 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.660723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852d4f0-89b2-45c3-8575-e50d5eff1762 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.661001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852d4f0-89b2-45c3-8575-e50d5eff1762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.665178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d22e-da74-4efc-a01c-c684e48317e5 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:36.665323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852d4f0-89b2-45c3-8575-e50d5eff1762 None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:36.665323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852d4f0-89b2-45c3-8575-e50d5eff1762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:36.665323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852d4f0-89b2-45c3-8575-e50d5eff1762 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:36.672851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 191/379] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:36 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:36.674093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051add99-21fe-4b53-af92-921dce8a03a8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.674386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051add99-21fe-4b53-af92-921dce8a03a8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.674667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051add99-21fe-4b53-af92-921dce8a03a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.712886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-051add99-21fe-4b53-af92-921dce8a03a8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:36.715834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-051add99-21fe-4b53-af92-921dce8a03a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:36.820317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:36.837938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d22e-da74-4efc-a01c-c684e48317e5 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:36.879333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 192/380] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:36.884806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:36.885934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:36.886461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:36.887004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] PATH_INFO: `/v3/groups/13961a3872e4468094d7fc4eb189c5d1` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:36.899134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] RBAC: Authorizing `identity:get_group(group_id=13961a3872e4468094d7fc4eb189c5d1)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:36.900852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:36.902566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 189/381] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:36 2022] GET /identity/v3/groups/13961a3872e4468094d7fc4eb189c5d1 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:36.908573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051add99-21fe-4b53-af92-921dce8a03a8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:36.920922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:37.044884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051add99-21fe-4b53-af92-921dce8a03a8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:37.075061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:37.091722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:37.092785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.093489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.093970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.095013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] RBAC: Adding query filter params (group.id=13961a3872e4468094d7fc4eb189c5d1, role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=4822884e35e54aa6816f97330f3285a9) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:37.095562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:37.098258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:37.106614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 193/382] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:36 2022] GET /identity/v3/role_assignments?group.id=13961a3872e4468094d7fc4eb189c5d1&scope.project.id=4822884e35e54aa6816f97330f3285a9&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:37.134301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f93ad6-2bc1-4c5a-ab62-c4e4e78a50c5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:37.175796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:37.176953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.177441 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.177923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.189757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:37.198230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:37.199308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:37.200762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:37.204081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 190/383] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:37.210010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:37.325242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eccc67-f7b3-4e87-b2cc-599350dfde04 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:37.367371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f9b9-6afe-4470-a170-baec1b8ea0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:37.368440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f9b9-6afe-4470-a170-baec1b8ea0b7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.368956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f9b9-6afe-4470-a170-baec1b8ea0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.369440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f9b9-6afe-4470-a170-baec1b8ea0b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.370407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f9b9-6afe-4470-a170-baec1b8ea0b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:37.370925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f9b9-6afe-4470-a170-baec1b8ea0b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:37.373104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f9b9-6afe-4470-a170-baec1b8ea0b7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:37.383183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 194/384] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:37.389067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:37.407258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:37.432555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc70d-c382-44e8-9e2c-c9361b72a412 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.432843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc70d-c382-44e8-9e2c-c9361b72a412 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.433025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc70d-c382-44e8-9e2c-c9361b72a412 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.436164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 195/385] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:37.440356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecbeb1-bb99-43db-b57c-18c106d7cdce None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.440645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecbeb1-bb99-43db-b57c-18c106d7cdce None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.440929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecbeb1-bb99-43db-b57c-18c106d7cdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.488290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b2ecbeb1-bb99-43db-b57c-18c106d7cdce None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:37.489512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b2ecbeb1-bb99-43db-b57c-18c106d7cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:37.503609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507446ad-72e8-4806-b483-58898a5bc833 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:37.547547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:37.548421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.548710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.548993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.552493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:37.556301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:37.560131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 191/386] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:37 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:37.572187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:37.580314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:37.612926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 196/387] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:37.647022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecbeb1-bb99-43db-b57c-18c106d7cdce None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:37.671350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:37.690385 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715ecc-30f1-4061-9d96-446a2a409608 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:37.733815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:37.734691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.734985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.735288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.740053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:37.741790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:37.744071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 192/388] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:37 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:37.750953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:37.868639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecbeb1-bb99-43db-b57c-18c106d7cdce None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:37.914916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aaefe-0d7d-4cac-a020-f11e2fb9c1b5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:37.944076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:37.944811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.945103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.945469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.956921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:37.960770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:37.961911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:37.962533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:37.963075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88/groups/7835befc1f74460ba42b6676ca4f650a/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:37.964747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:37.966234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:37.967074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 197/389] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:37.968514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee573fc7a3445568d49498c20f3ed88, group_id=7835befc1f74460ba42b6676ca4f650a, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:37.970115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:37.976324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:37.991795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 193/390] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 23 13:33:37 2022] PUT /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88/groups/7835befc1f74460ba42b6676ca4f650a/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:33:38.066470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:38.136407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777d5f9-45ec-4785-8e70-22fd4f5451a4 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:38.181318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62f693-43a6-4b37-90a4-cd55c389b91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:38.181994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f693-43a6-4b37-90a4-cd55c389b91b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.182281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f693-43a6-4b37-90a4-cd55c389b91b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.182560 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f693-43a6-4b37-90a4-cd55c389b91b None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.183403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62f693-43a6-4b37-90a4-cd55c389b91b None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:38.183715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62f693-43a6-4b37-90a4-cd55c389b91b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:38.185663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62f693-43a6-4b37-90a4-cd55c389b91b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:38.196596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 198/391] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:38.201687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:38.216300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:38.288387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8665fe-e3b7-4536-b899-2272f76a3418 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.288731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8665fe-e3b7-4536-b899-2272f76a3418 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.288952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8665fe-e3b7-4536-b899-2272f76a3418 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.290461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 199/392] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:38.296248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916475f-963d-4a2f-a4c4-b413bb6503fc None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.296248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916475f-963d-4a2f-a4c4-b413bb6503fc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.296248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916475f-963d-4a2f-a4c4-b413bb6503fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.333129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1916475f-963d-4a2f-a4c4-b413bb6503fc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:38.334324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1916475f-963d-4a2f-a4c4-b413bb6503fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:38.379291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2d8fa-5e37-40c0-886a-82b9cf74a93a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:38.436488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:38.437407 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.437735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.438076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.439574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:38.441017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:38.447380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 194/393] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:38 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:38.449156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:38.508572 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 200/394] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 23 13:33:38.543811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916475f-963d-4a2f-a4c4-b413bb6503fc None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:38.553734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:38.597752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ec36-ee15-464e-8b23-bae62ab3804d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:38.599328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:38.677297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:38.678493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.678973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.679430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.682074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:38.686377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:38.695867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 195/395] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:38 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:38.709960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:38.750447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916475f-963d-4a2f-a4c4-b413bb6503fc None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:38.825851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:38.826671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.826960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.827263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.857560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664540-cd05-47e4-8668-fcb3897411a9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:38.860784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:38.876899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:38.877825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:38.878816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 201/396] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:38.888560 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:38.898352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:38.899658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:38.900122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:38.900577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/groups/7835befc1f74460ba42b6676ca4f650a/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:38.903249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] RBAC: Authorizing `identity:create_grant(project_id=0895df0c00c34b62a8aea3f9c28b1ade, group_id=7835befc1f74460ba42b6676ca4f650a, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:38.904940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:38.945288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 196/397] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 23 13:33:38 2022] PUT /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/groups/7835befc1f74460ba42b6676ca4f650a/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:39.015622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:39.031723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb7ec0-44c2-4be7-8679-0686aa8e00fd None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:39.078553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:39.079268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.079562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.079901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.080682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:39.080994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:39.082391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:39.095613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 202/398] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:39.097774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:39.108190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:39.219234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c47c1-bdfa-40f8-b0cd-5f59b88c6aba None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:39.271546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5c3e7-f42a-4766-bfef-32606e6f92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:39.272327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c3e7-f42a-4766-bfef-32606e6f92ce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.272610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c3e7-f42a-4766-bfef-32606e6f92ce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.272887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c3e7-f42a-4766-bfef-32606e6f92ce None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.274124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5c3e7-f42a-4766-bfef-32606e6f92ce None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:39.275645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5c3e7-f42a-4766-bfef-32606e6f92ce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:39.278771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 197/399] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:39 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:39.283495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:39.350972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794968a-fb0e-4d3e-b5da-ef738d7beade None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.351312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794968a-fb0e-4d3e-b5da-ef738d7beade None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.351557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794968a-fb0e-4d3e-b5da-ef738d7beade None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.353223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 198/400] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:39.358510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0197-f672-408d-bcb2-7325bb76ad1b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.358799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0197-f672-408d-bcb2-7325bb76ad1b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.359085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0197-f672-408d-bcb2-7325bb76ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.392277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-04fb0197-f672-408d-bcb2-7325bb76ad1b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:39.393484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-04fb0197-f672-408d-bcb2-7325bb76ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:39.399768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b10b3-c528-4c7a-81b4-d7c5d3869644 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:39.435636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:39.436520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.436818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.437110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.438325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:39.439837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:39.441851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 203/401] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:39 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:39.447252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:39.499570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:39.521516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 199/402] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:39.523848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab524e-63fe-49b2-a1eb-b8bbfe00707d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.524089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab524e-63fe-49b2-a1eb-b8bbfe00707d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.524377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab524e-63fe-49b2-a1eb-b8bbfe00707d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.530370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 200/403] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:39.531565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03690-c416-4f99-a9fd-b47e2ee308f3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.531861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03690-c416-4f99-a9fd-b47e2ee308f3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.532149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03690-c416-4f99-a9fd-b47e2ee308f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.544055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:39.559411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-76b03690-c416-4f99-a9fd-b47e2ee308f3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:39.560985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-76b03690-c416-4f99-a9fd-b47e2ee308f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:39.600624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e50b6-b36b-49eb-ac38-1833bfd7e29f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:39.637723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:39.639113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.639615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.640202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88/groups/7835befc1f74460ba42b6676ca4f650a/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.642972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] RBAC: Authorizing `identity:create_grant(project_id=5ee573fc7a3445568d49498c20f3ed88, group_id=7835befc1f74460ba42b6676ca4f650a, role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:39.644840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:39.650171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 201/404] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:39.651369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03690-c416-4f99-a9fd-b47e2ee308f3 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:39.664762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 204/405] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 23 13:33:39 2022] PUT /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88/groups/7835befc1f74460ba42b6676ca4f650a/roles/7375d2caebd143e29bfb064c04af61e7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:33:39.687026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:39.850750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03690-c416-4f99-a9fd-b47e2ee308f3 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:39.863233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:39.892761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92494-5b40-4bce-bcc2-b3d6055ea6af None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:39.897193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:39.906401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:39.908106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.908742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.909225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.925261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:39.937358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:39.938391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:39.939196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:39.939857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:39.940661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:39.940954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:39.941240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:39.942783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 202/406] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:39.949647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:39.958160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:39.967569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:39.968470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:39.969933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 205/407] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:39.975980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.147855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43cfa-41d5-42b7-a129-781d2d51c64f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.172347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f609258-d8c5-4fa5-80e4-8e3f9c3edc0d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.212315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.213000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.213290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.213574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.214393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:40.214717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.216705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.225731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 203/408] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:40.231194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.247292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.247974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.248265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.248547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.249314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:40.249629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.253495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.272546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 206/409] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:40.278449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.284143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:40.339829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:40.390396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156fb5-e34d-46a2-8da6-766f89c32676 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.429274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bed79-7267-49e1-a90d-71334614b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.430069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bed79-7267-49e1-a90d-71334614b828 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.430358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bed79-7267-49e1-a90d-71334614b828 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.430643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bed79-7267-49e1-a90d-71334614b828 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.431844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bed79-7267-49e1-a90d-71334614b828 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.432865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233ced0-a8f3-4393-b5d4-a15567692867 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.433295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bed79-7267-49e1-a90d-71334614b828 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.435809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 204/410] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:40 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:40.437026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e212004-d7dd-46d6-b0ae-32c1296cdb0d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.437316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e212004-d7dd-46d6-b0ae-32c1296cdb0d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.437602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e212004-d7dd-46d6-b0ae-32c1296cdb0d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.443991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 205/411] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:40.448120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e212004-d7dd-46d6-b0ae-32c1296cdb0d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.472126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a3927-9325-43f8-83d9-d815746f6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.472969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a3927-9325-43f8-83d9-d815746f6232 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.473255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a3927-9325-43f8-83d9-d815746f6232 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.473645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a3927-9325-43f8-83d9-d815746f6232 None admin] PATH_INFO: `/v3/groups/13961a3872e4468094d7fc4eb189c5d1` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.474826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a3927-9325-43f8-83d9-d815746f6232 None admin] RBAC: Authorizing `identity:get_group(group_id=13961a3872e4468094d7fc4eb189c5d1)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.476486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a3927-9325-43f8-83d9-d815746f6232 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.478521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 207/412] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:40 2022] GET /identity/v3/groups/13961a3872e4468094d7fc4eb189c5d1 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:40.482203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145f62-14c0-405f-8b5d-fbd044de3fd8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.482203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145f62-14c0-405f-8b5d-fbd044de3fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.482203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145f62-14c0-405f-8b5d-fbd044de3fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.500312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-52145f62-14c0-405f-8b5d-fbd044de3fd8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:40.502389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-52145f62-14c0-405f-8b5d-fbd044de3fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:40.562174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e212004-d7dd-46d6-b0ae-32c1296cdb0d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.576301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:40.577241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145f62-14c0-405f-8b5d-fbd044de3fd8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.585187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:40.604138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:40.623155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.624804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.625438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.626081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.628024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.629731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.633776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 206/414] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:40 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:40.634703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.683493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145f62-14c0-405f-8b5d-fbd044de3fd8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.720657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.721672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.721899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.722179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] PATH_INFO: `/v3/projects/4822884e35e54aa6816f97330f3285a9` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.723397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4822884e35e54aa6816f97330f3285a9)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.724940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.726942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 209/415] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:40 2022] GET /identity/v3/projects/4822884e35e54aa6816f97330f3285a9 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:40.727469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.749341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c7978-77bb-46f4-997a-e21b752939e8 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.786184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.787316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.787768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.788191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.799689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:40.800284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:40.810597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:40.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:40.812694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:40.819504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 207/416] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:40.820575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.831716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d89a2-8e53-43c0-a724-2a5b3a9e11e3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:40.869158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:40.870148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:40.870433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:40.870733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/groups/7835befc1f74460ba42b6676ca4f650a/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:40.873096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] RBAC: Authorizing `identity:create_grant(project_id=0895df0c00c34b62a8aea3f9c28b1ade, group_id=7835befc1f74460ba42b6676ca4f650a, role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:40.874663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:40.877828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:40.892520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 210/417] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 23 13:33:40 2022] PUT /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade/groups/7835befc1f74460ba42b6676ca4f650a/roles/7375d2caebd143e29bfb064c04af61e7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:40.893540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:40.975933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d81b35-4972-4d51-bc08-bbd4b6cb7b11 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:41.026101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:41.028084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:41.028653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:41.029139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] PATH_INFO: `/v3/projects/4822884e35e54aa6816f97330f3285a9/groups/13961a3872e4468094d7fc4eb189c5d1/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:41.032455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] RBAC: Authorizing `identity:create_grant(project_id=4822884e35e54aa6816f97330f3285a9, group_id=13961a3872e4468094d7fc4eb189c5d1, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:41.034522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:41.051718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 208/418] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 23 13:33:40 2022] PUT /identity/v3/projects/4822884e35e54aa6816f97330f3285a9/groups/13961a3872e4468094d7fc4eb189c5d1/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:33:41.103347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4e9d4-64b6-4fc6-b98c-fbfc335c6e32 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:41.138174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:41.145254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddc993-9ed1-4f9e-aa00-d5a50241fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:41.146582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc993-9ed1-4f9e-aa00-d5a50241fb01 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:41.147341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc993-9ed1-4f9e-aa00-d5a50241fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:41.148287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc993-9ed1-4f9e-aa00-d5a50241fb01 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:41.149064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddc993-9ed1-4f9e-aa00-d5a50241fb01 None admin] RBAC: Adding query filter params (name=member) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:41.149695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddc993-9ed1-4f9e-aa00-d5a50241fb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:41.151139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddc993-9ed1-4f9e-aa00-d5a50241fb01 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:41.161762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 211/419] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:41.167925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:41.283882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcbbe9-4cb9-446a-8d55-7378ee8a1edf None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:41.295163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:41.320192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:41.320852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:41.321143 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:41.321424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:41.394648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:41.396169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:41.532192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 209/420] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:41.537853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6f98c-88d4-49a6-9b95-3d66ad964880 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:41.538295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6f98c-88d4-49a6-9b95-3d66ad964880 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:41.538371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6f98c-88d4-49a6-9b95-3d66ad964880 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:41.539752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 212/421] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:41.540677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:41.553697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38876-be03-49fc-91de-96015cf6e64d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:41.554021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38876-be03-49fc-91de-96015cf6e64d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:41.554261 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38876-be03-49fc-91de-96015cf6e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:41.554914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:41.575412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0fe38876-be03-49fc-91de-96015cf6e64d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:41.576592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0fe38876-be03-49fc-91de-96015cf6e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:41.698724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea1266-ae9b-429b-81a4-bdd5138c0674 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:41.705653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 213/422] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:41.735338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:41.737822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38876-be03-49fc-91de-96015cf6e64d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:41.739317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:41.741246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:41.741529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:41.743568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:41.745027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:41.751613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 210/423] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:41 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:41.757060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:41.870328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:41.894201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e6ca-0bcd-453b-9645-07d0c2fe1e2e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:41.930525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:41.931598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:41.932488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:41.932882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:41.938193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:41.938193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:41.938487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 211/424] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:41 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:41.944309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:42.004904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38876-be03-49fc-91de-96015cf6e64d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.055562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:42.078845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa0b5-7e8f-49ca-af58-087e70188d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.079673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa0b5-7e8f-49ca-af58-087e70188d83 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.079961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa0b5-7e8f-49ca-af58-087e70188d83 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.080239 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa0b5-7e8f-49ca-af58-087e70188d83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.105084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fa0b5-7e8f-49ca-af58-087e70188d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-ff5fa0b5-7e8f-49ca-af58-087e70188d83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:42.113904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:42.114808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 13:33:42.115662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:42.116292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33861-6fad-43a3-ad5f-b96619f0e768 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.116691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 214/425] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:42.116760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f92a9-9fa0-40c6-a30f-14f4700ebad5 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.117329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f92a9-9fa0-40c6-a30f-14f4700ebad5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.117329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f92a9-9fa0-40c6-a30f-14f4700ebad5 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.122491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 215/426] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:42.124251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904dd5-86c6-461b-9d8d-6272f4e89b1f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.124541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904dd5-86c6-461b-9d8d-6272f4e89b1f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.124823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904dd5-86c6-461b-9d8d-6272f4e89b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.142086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8c904dd5-86c6-461b-9d8d-6272f4e89b1f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:42.143381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8c904dd5-86c6-461b-9d8d-6272f4e89b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:42.160745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.161735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.162024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.162306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.163196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=5ee573fc7a3445568d49498c20f3ed88) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:42.163536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:42.165750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:42.175050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 212/427] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:41 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=d38549e73a3b4007b78d77d91a93026f => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:42.176072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:42.191876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:42.275237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 216/428] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:42.315412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904dd5-86c6-461b-9d8d-6272f4e89b1f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:42.327186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2fad-f169-4cb8-aab8-48219571e1ce None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.387568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.388377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.388668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.388949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.389708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] RBAC: Adding query filter params (name=member) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:42.390018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:42.392880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:42.405770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 213/429] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:33:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:42.411564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:42.478878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904dd5-86c6-461b-9d8d-6272f4e89b1f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.503785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:42.505458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:42.530696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.534025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.534599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.535114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.542166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260219-de95-43c4-b465-5ece42db2e66 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.549476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:42.558649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:42.559615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:42.560401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:42.567327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 217/430] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:42.569154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:42.579673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.579673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.579673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.579673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.668117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:42.670313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:42.691878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54138a7-89f6-4cd7-89a9-cedae5f679f8 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.732801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.733805 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.734304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.734787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.735774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:42.736284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:42.737860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:42.752142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 218/431] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:42.753451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:42.756981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:42.801450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:42.804230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 214/432] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:42.810298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:42.882854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d026-76ce-4a90-b22f-0920b536e270 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.919353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.919935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.920231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.920513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.936524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d16014-104a-41a4-ba04-c71b02077d8b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:42.977340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:42.978212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:42.978504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:42.978790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:42.980023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:42.982608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:42.985259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 215/433] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:42 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:42.990752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.001809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:43.003643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:43.039940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.047846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.108977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed966f-1127-4269-9961-50f0d433938e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.125696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 219/434] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:43.127445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.146386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.147299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.147593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.147909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.149161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:43.150814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:43.152804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 216/435] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:42 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:43.158589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.248642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf744b6-a29c-4d7c-bdee-eb3496beb9a0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.267014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd1b0-1167-4526-90cd-7634528a9ae1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.277389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.295939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.296938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.297491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.297783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] PATH_INFO: `/v3/projects/5ee573fc7a3445568d49498c20f3ed88` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.299780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] RBAC: Authorizing `identity:get_project(project_id=5ee573fc7a3445568d49498c20f3ed88)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:43.301250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:43.303149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 220/436] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/projects/5ee573fc7a3445568d49498c20f3ed88 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:43.309405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.312331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.313541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577cf51-7b1a-4cc3-b2da-5200b3b7e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.314315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577cf51-7b1a-4cc3-b2da-5200b3b7e734 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.315376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577cf51-7b1a-4cc3-b2da-5200b3b7e734 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.316506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577cf51-7b1a-4cc3-b2da-5200b3b7e734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.317504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577cf51-7b1a-4cc3-b2da-5200b3b7e734 None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=d38549e73a3b4007b78d77d91a93026f, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:43.319670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577cf51-7b1a-4cc3-b2da-5200b3b7e734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:43.321290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577cf51-7b1a-4cc3-b2da-5200b3b7e734 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:43.335245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 217/437] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=d38549e73a3b4007b78d77d91a93026f => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:43.398057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d784-5d2f-4817-a3e0-6d6897cfc988 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.398372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d784-5d2f-4817-a3e0-6d6897cfc988 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.398650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d784-5d2f-4817-a3e0-6d6897cfc988 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.401577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 218/438] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:43.406149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d94f-330f-47b2-ac07-7660e074504d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.406435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d94f-330f-47b2-ac07-7660e074504d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.406719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d94f-330f-47b2-ac07-7660e074504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.424369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2b74d94f-330f-47b2-ac07-7660e074504d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:43.425567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2b74d94f-330f-47b2-ac07-7660e074504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:43.441118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87df0-6c3d-43f3-93f2-806b3a6db285 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.488571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993368-faeb-4ae7-9937-847ec04c9e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.489442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993368-faeb-4ae7-9937-847ec04c9e9b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.489730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993368-faeb-4ae7-9937-847ec04c9e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.490008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993368-faeb-4ae7-9937-847ec04c9e9b None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.491188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993368-faeb-4ae7-9937-847ec04c9e9b None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:43.492689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993368-faeb-4ae7-9937-847ec04c9e9b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:43.494600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 221/439] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:43.495820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81781-2e77-4606-b05a-16f26163ece6 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.496106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81781-2e77-4606-b05a-16f26163ece6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.496924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81781-2e77-4606-b05a-16f26163ece6 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.499300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 222/440] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:43.501021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81781-2e77-4606-b05a-16f26163ece6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.516160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 219/441] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:43.517539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63decd2c-42db-400e-b54f-821c939a071e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.517907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63decd2c-42db-400e-b54f-821c939a071e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.518285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63decd2c-42db-400e-b54f-821c939a071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.534799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-63decd2c-42db-400e-b54f-821c939a071e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:43.536018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-63decd2c-42db-400e-b54f-821c939a071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:43.586325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.607697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 220/442] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:43.608530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63decd2c-42db-400e-b54f-821c939a071e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.619762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81781-2e77-4606-b05a-16f26163ece6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.638859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.655162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.655844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.656131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.656412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.657241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=5ee573fc7a3445568d49498c20f3ed88) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:43.657555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:43.659004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:43.665117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 223/443] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=5ee573fc7a3445568d49498c20f3ed88&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:43.665875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.726422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63decd2c-42db-400e-b54f-821c939a071e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.766433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.767516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.767951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.768388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.780465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064918-8b06-42a3-b172-4b324e0477e3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.780728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:43.788585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:43.789563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:33:43.790388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:43.795027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 221/444] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:43.796039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.818908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.819781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.820069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.820352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.822258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.833855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:43.842629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:43.843635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:43.844446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 224/445] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:43.850942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:43.911398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:43.924417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf826c-1f57-4533-a7be-2b6f7912e662 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.964956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:43.966272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:43.966561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:43.966840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:43.967990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:43.967990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:43.970371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:43.974244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ca9d5-c5a8-4752-9b91-d26ae12ff57f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:43.977761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 222/446] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:43.984459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.021973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.022880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.023174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.023483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.024247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:44.024582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.025958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.035991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 225/447] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:44.041606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.106917 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013981cf-b61a-4e63-a00f-8aac7cabe11e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.112053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:44.148695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.149656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.149951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.150235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.169141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ef528-e8b4-4564-8250-9830ab9f3995 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.180768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:44.208535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.209196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.209490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.209777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.225396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.226849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.276389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.278559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.323596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 223/448] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:44.329253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.331512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:44.376478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 226/449] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:44.381935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.388169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:44.432520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d536c-f5fb-47e2-995e-e0303c622ff7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.466254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.467581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.467876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.468157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] PATH_INFO: `/v3/projects/4822884e35e54aa6816f97330f3285a9` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.469368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] RBAC: Authorizing `identity:get_project(project_id=4822884e35e54aa6816f97330f3285a9)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.470812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.472541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 224/450] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:44 2022] GET /identity/v3/projects/4822884e35e54aa6816f97330f3285a9 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:44.478705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.479905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243e061-944d-43ea-b98b-1aeea16370bb None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.516847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.517701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.517983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.518254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] PATH_INFO: `/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.519439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] RBAC: Authorizing `identity:get_project(project_id=0895df0c00c34b62a8aea3f9c28b1ade)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.520877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.522529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 227/451] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:33:44 2022] GET /identity/v3/projects/0895df0c00c34b62a8aea3f9c28b1ade => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:44.527865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.551621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:44.577673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9672f-f911-4d2b-a47b-d404fea1ef96 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.599216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:44.610957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.611842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.612124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.612397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] PATH_INFO: `/v3/groups/13961a3872e4468094d7fc4eb189c5d1` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.613554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] RBAC: Authorizing `identity:get_group(group_id=13961a3872e4468094d7fc4eb189c5d1)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.614993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.616617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 225/452] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:44 2022] GET /identity/v3/groups/13961a3872e4468094d7fc4eb189c5d1 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:44.622874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.623936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87053ddc-37aa-4145-bfa7-7b448f4f411a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.657513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.658348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.658631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.658905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] PATH_INFO: `/v3/groups/7835befc1f74460ba42b6676ca4f650a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.660090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] RBAC: Authorizing `identity:get_group(group_id=7835befc1f74460ba42b6676ca4f650a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.661536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.663123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 228/453] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 23 13:33:44 2022] GET /identity/v3/groups/7835befc1f74460ba42b6676ca4f650a => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:44.669272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:44.718556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e289761-3b4f-4eeb-b02a-c7957475cb23 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.751657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e1457-0476-439c-b62a-ad61f753b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.752302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e1457-0476-439c-b62a-ad61f753b64a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.752587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e1457-0476-439c-b62a-ad61f753b64a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.752873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e1457-0476-439c-b62a-ad61f753b64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.753687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e1457-0476-439c-b62a-ad61f753b64a None admin] RBAC: Adding query filter params (group.id=13961a3872e4468094d7fc4eb189c5d1, role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=4822884e35e54aa6816f97330f3285a9) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:44.753995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e1457-0476-439c-b62a-ad61f753b64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.755434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e1457-0476-439c-b62a-ad61f753b64a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.756549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:44.761296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 226/454] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:44 2022] GET /identity/v3/role_assignments?group.id=13961a3872e4468094d7fc4eb189c5d1&scope.project.id=4822884e35e54aa6816f97330f3285a9&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:44.765636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a572c-d5c1-433c-80dd-bb79f8ca8313 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:44.803186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05949c7a-5d12-4440-b66e-9b690d16e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:44.803828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05949c7a-5d12-4440-b66e-9b690d16e579 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:44.804119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05949c7a-5d12-4440-b66e-9b690d16e579 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:44.804398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05949c7a-5d12-4440-b66e-9b690d16e579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:44.805247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05949c7a-5d12-4440-b66e-9b690d16e579 None admin] RBAC: Adding query filter params (group.id=7835befc1f74460ba42b6676ca4f650a, role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:44.805564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05949c7a-5d12-4440-b66e-9b690d16e579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:44.807039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05949c7a-5d12-4440-b66e-9b690d16e579 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:44.814492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 229/455] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 23 13:33:44 2022] GET /identity/v3/role_assignments?group.id=7835befc1f74460ba42b6676ca4f650a&scope.project.id=0895df0c00c34b62a8aea3f9c28b1ade&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:47.469079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c97fb-766e-47f0-a466-699e3decb908 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:47.469586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c97fb-766e-47f0-a466-699e3decb908 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:47.469662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c97fb-766e-47f0-a466-699e3decb908 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:47.471245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 227/456] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:47.476550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29cbb5-8800-4a25-9617-82dcd809f7af None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:47.476932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29cbb5-8800-4a25-9617-82dcd809f7af None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:47.477113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29cbb5-8800-4a25-9617-82dcd809f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:47.501344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0b29cbb5-8800-4a25-9617-82dcd809f7af None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:47.502541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0b29cbb5-8800-4a25-9617-82dcd809f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:47.593875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 230/457] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:47.642211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c97fb-766e-47f0-a466-699e3decb908 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:47.655425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c797e-5971-4a4f-b674-4b62c5bd49da None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:47.655720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c797e-5971-4a4f-b674-4b62c5bd49da None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:47.656006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c797e-5971-4a4f-b674-4b62c5bd49da None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:47.658921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 231/458] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:47.664501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336aa1e-ef3d-45c2-b55d-130fcc2dc71e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:47.664958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336aa1e-ef3d-45c2-b55d-130fcc2dc71e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:47.665374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336aa1e-ef3d-45c2-b55d-130fcc2dc71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:47.691238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9336aa1e-ef3d-45c2-b55d-130fcc2dc71e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:47.692724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9336aa1e-ef3d-45c2-b55d-130fcc2dc71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:47.728802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:47.774686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 232/459] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:47.776321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbac6a-c260-402a-bbff-bf747f43c862 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:47.776758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbac6a-c260-402a-bbff-bf747f43c862 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:47.777180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbac6a-c260-402a-bbff-bf747f43c862 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:47.778473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c97fb-766e-47f0-a466-699e3decb908 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:47.782814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 233/460] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:47.784460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4869-dfd3-4edc-9117-1819b719b20f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:47.784894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4869-dfd3-4edc-9117-1819b719b20f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:47.785314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4869-dfd3-4edc-9117-1819b719b20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:47.802613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3bdf4869-dfd3-4edc-9117-1819b719b20f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:47.804184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3bdf4869-dfd3-4edc-9117-1819b719b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:47.814471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:47.815607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:47.816115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:47.816586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:47.817186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:47.829087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:47.830840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:47.850044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:47.850943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:47.851820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:47.851820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:47.851820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:47.851820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:47.854109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 228/461] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:47.855084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:47.887411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 234/462] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:47.888308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf4869-dfd3-4edc-9117-1819b719b20f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:47.964818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576c1b-2970-4c4b-aeb3-a44a84af50d0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:47.973029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.003228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.004081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.004485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.004861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.006268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf4869-dfd3-4edc-9117-1819b719b20f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.017308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.018871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:48.038088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:48.039003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:48.039996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:48.039996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:48.039996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:48.039996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:48.044539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 229/463] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:48.045324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.045459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.046354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.046867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.047316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.048277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:48.048728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.050399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.070049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 235/464] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:48.071471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.081423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.146771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc08ec-d53b-4683-9f30-95cae07dc594 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.180884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.181182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ae768-6fcf-42ad-9a66-b3024bf63979 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.181667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.181951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.182230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.194730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.196230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:48.213667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:48.214516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:48.216099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:48.216099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:48.216099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:48.216099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:48.216099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 230/465] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:48.216099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.221464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87691ebf-07f8-4e91-b98b-6acd259e0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.222125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691ebf-07f8-4e91-b98b-6acd259e0da7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.222413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691ebf-07f8-4e91-b98b-6acd259e0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.222693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691ebf-07f8-4e91-b98b-6acd259e0da7 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.223449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87691ebf-07f8-4e91-b98b-6acd259e0da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:48.223763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87691ebf-07f8-4e91-b98b-6acd259e0da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.225158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87691ebf-07f8-4e91-b98b-6acd259e0da7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.228414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.244744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 236/466] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:48.244744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73476b1f-3b2d-4d26-af2a-1850106fbe18 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.244744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73476b1f-3b2d-4d26-af2a-1850106fbe18 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.244744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73476b1f-3b2d-4d26-af2a-1850106fbe18 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.246841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 237/467] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:48.250887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73476b1f-3b2d-4d26-af2a-1850106fbe18 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.320115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.331066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f2ea2-1dcb-4b51-912a-684e74ca1b5f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.356042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73476b1f-3b2d-4d26-af2a-1850106fbe18 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.367852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.368528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.368822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.369104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.369817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.371837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.400718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 231/468] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:48 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:48.400718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.403412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd199-17eb-4028-a0d4-12010715d2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.403412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd199-17eb-4028-a0d4-12010715d2e5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.403412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd199-17eb-4028-a0d4-12010715d2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.403412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd199-17eb-4028-a0d4-12010715d2e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.404120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd199-17eb-4028-a0d4-12010715d2e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:48.404402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd199-17eb-4028-a0d4-12010715d2e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.405879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd199-17eb-4028-a0d4-12010715d2e5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.421353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 238/469] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:48.422956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea4a1-1561-4863-be65-e1b8eb6229a8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.423274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea4a1-1561-4863-be65-e1b8eb6229a8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.423948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea4a1-1561-4863-be65-e1b8eb6229a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.448116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-132ea4a1-1561-4863-be65-e1b8eb6229a8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:48.449543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-132ea4a1-1561-4863-be65-e1b8eb6229a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:48.477088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.526094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03330971-151e-4d6d-ad45-c0fb02844e02 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.551422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 239/470] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:48.552292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea4a1-1561-4863-be65-e1b8eb6229a8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.583652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.584651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.585117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.585591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.586484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.588240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.614477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 232/471] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:48 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:48.615636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.642112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.698648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea4a1-1561-4863-be65-e1b8eb6229a8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.752469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.752992 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.753276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.753549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.754261 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.755811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.782419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc650-43d7-4914-bb76-4e3d29530f7d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:48.795363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 240/472] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:48 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:48.810652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:48.826697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a3721-ccda-47ee-b89b-88c065bad38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:48.827974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3721-ccda-47ee-b89b-88c065bad38b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.828419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3721-ccda-47ee-b89b-88c065bad38b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.828835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3721-ccda-47ee-b89b-88c065bad38b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.845985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a3721-ccda-47ee-b89b-88c065bad38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:48.847786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a3721-ccda-47ee-b89b-88c065bad38b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-dc0a3721-ccda-47ee-b89b-88c065bad38b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:48.868287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:48.869427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:48.870493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:48.870493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:48.870493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:48.870493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:48.873119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 233/473] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:48.880051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:48.911798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e8a8-0176-49b5-ad3b-c40392c0ae36 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.912752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e8a8-0176-49b5-ad3b-c40392c0ae36 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.913210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e8a8-0176-49b5-ad3b-c40392c0ae36 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.915814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 234/474] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:48.922793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846054e-18cc-45aa-a30d-1191ba97dc02 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:48.923103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846054e-18cc-45aa-a30d-1191ba97dc02 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:48.923398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846054e-18cc-45aa-a30d-1191ba97dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:48.942389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9846054e-18cc-45aa-a30d-1191ba97dc02 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:48.943717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9846054e-18cc-45aa-a30d-1191ba97dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:49.010489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444ef58-ec3d-48d9-867f-5990d52f1ec8 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:49.026588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:49.037542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 235/475] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:49.055544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:49.056223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:49.056514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:49.056802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:49.057542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:49.057855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:49.059858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:49.063833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846054e-18cc-45aa-a30d-1191ba97dc02 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:49.072499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 241/476] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:49.077629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:49.199899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2e08-b02d-43da-a7a3-db255457a563 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:49.219251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846054e-18cc-45aa-a30d-1191ba97dc02 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:49.222494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:49.240326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:49.241014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:49.241302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:49.241585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:49.242303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:49.243821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:49.270546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 242/477] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:49 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:33:49.276716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:49.277817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:49.278307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:49.278783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:49.279812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:49.281565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:49.300464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.sql.core [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 13:33:49.300464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 13:33:49.300464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [parameters: {'id': 'b9271d37ec484b9c9a418f1c05c396d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 13:33:49.300464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86768) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result.read() Jun 23 13:33:49.326884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:33:49.327874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application yield resource Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise self.value Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application session.commit() Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 13:33:49.328805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.session.flush() Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application compat.raise_( Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 13:33:49.329668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:33:49.330552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result.read() Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:33:49.331439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [parameters: {'id': 'b9271d37ec484b9c9a418f1c05c396d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:49.332249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 13:33:49.333056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:49.338203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 236/478] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 23 13:33:49 2022] POST /identity/v3/roles => generated 144 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:49.343664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:49.383689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:49.470415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c555f-8504-47ca-a526-145404a8b6b9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:49.509354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99de8db-bf9d-4203-9ef1-c3c06cc95a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:49.510497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99de8db-bf9d-4203-9ef1-c3c06cc95a4a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:49.510979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99de8db-bf9d-4203-9ef1-c3c06cc95a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:49.511489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99de8db-bf9d-4203-9ef1-c3c06cc95a4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:49.523653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99de8db-bf9d-4203-9ef1-c3c06cc95a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-f99de8db-bf9d-4203-9ef1-c3c06cc95a4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:49.532065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:49.532943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 13:33:49.533771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:49.540756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 243/479] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:33:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:49.542315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:49.648844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658b8af-7f88-4a2c-b01a-ebd2b1ed962b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:49.683057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1ab59-341b-42c0-a55f-e390394e1d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:49.684367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1ab59-341b-42c0-a55f-e390394e1d82 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:49.684651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1ab59-341b-42c0-a55f-e390394e1d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:49.684925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1ab59-341b-42c0-a55f-e390394e1d82 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:49.685677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1ab59-341b-42c0-a55f-e390394e1d82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:49.685986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1ab59-341b-42c0-a55f-e390394e1d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:49.687373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1ab59-341b-42c0-a55f-e390394e1d82 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:49.696019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 237/480] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:51.053802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c087-1c71-4296-96d7-21dd46b2891f None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.054796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c087-1c71-4296-96d7-21dd46b2891f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.055308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c087-1c71-4296-96d7-21dd46b2891f None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.057163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 244/481] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:51.062060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e663-30d7-4561-ae9a-8b61c1d40c6e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.062836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e663-30d7-4561-ae9a-8b61c1d40c6e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.063368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e663-30d7-4561-ae9a-8b61c1d40c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.082985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2a25e663-30d7-4561-ae9a-8b61c1d40c6e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:51.084473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2a25e663-30d7-4561-ae9a-8b61c1d40c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:51.118095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:51.177349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 238/482] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:51.212296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c087-1c71-4296-96d7-21dd46b2891f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:51.352850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:51.373295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c087-1c71-4296-96d7-21dd46b2891f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:51.420384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1b77c-4dbc-4d62-b663-58d8926a7e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:51.420620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2968b-946f-4d38-bed5-062e75748255 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.420857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2968b-946f-4d38-bed5-062e75748255 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.421192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1b77c-4dbc-4d62-b663-58d8926a7e7a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.421465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2968b-946f-4d38-bed5-062e75748255 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.421576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1b77c-4dbc-4d62-b663-58d8926a7e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.421802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1b77c-4dbc-4d62-b663-58d8926a7e7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.423478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 239/483] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:51.435432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1b77c-4dbc-4d62-b663-58d8926a7e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-5cb1b77c-4dbc-4d62-b663-58d8926a7e7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:51.443376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:51.444370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:51.445188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 245/484] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:51.450569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2968b-946f-4d38-bed5-062e75748255 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:51.451902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a29364-26cd-4bda-b410-a76ef7aa296d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.452484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a29364-26cd-4bda-b410-a76ef7aa296d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.452775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a29364-26cd-4bda-b410-a76ef7aa296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.476242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-79a29364-26cd-4bda-b410-a76ef7aa296d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:51.477445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-79a29364-26cd-4bda-b410-a76ef7aa296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:51.565882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 246/485] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:51.567446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9802c2f-0a26-4a1f-ab32-34ebb10439df None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.567743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9802c2f-0a26-4a1f-ab32-34ebb10439df None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.568025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9802c2f-0a26-4a1f-ab32-34ebb10439df None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.573287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 247/486] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:51.574829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32dcc-b019-4f3e-a57d-fc0732ffb62c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.575432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32dcc-b019-4f3e-a57d-fc0732ffb62c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.575872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32dcc-b019-4f3e-a57d-fc0732ffb62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.592902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2968b-946f-4d38-bed5-062e75748255 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:51.593366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-6fb32dcc-b019-4f3e-a57d-fc0732ffb62c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:51.594813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-6fb32dcc-b019-4f3e-a57d-fc0732ffb62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:51.635940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:51.636932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.637402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.637962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.638899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:51.639431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:51.641347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:51.655375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 240/487] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:51.656590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:51.666361 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 248/488] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:51.672326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb32dcc-b019-4f3e-a57d-fc0732ffb62c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:51.689865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:51.699781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:51.792494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d7c0-ccdc-4188-9e26-1041cb05b447 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:51.796441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb32dcc-b019-4f3e-a57d-fc0732ffb62c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:51.838176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:51.838973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.839291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.839586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.842873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:51.843935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:51.844415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:51.844900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:51.850204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:51.852084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:51.858160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:51.867288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:51.868406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:51.869442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:51.876392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 241/489] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:51.876392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:51.879665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:51.880605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:51.881477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:51.881477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:51.881477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:51.881477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:51.888696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 249/490] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:51.889924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:51.955830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:51.983069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.001642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a49824-48cc-4a31-afd0-e61a2aabe6c2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.008035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923866d-4586-4de9-bf32-c3efd55cd399 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.041656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.042697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.043892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.044362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.045321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:52.045815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.047385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.054972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06431a6-1b9b-445c-a7f7-2fad5ada3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.055803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06431a6-1b9b-445c-a7f7-2fad5ada3fec None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.056090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06431a6-1b9b-445c-a7f7-2fad5ada3fec None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.056369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06431a6-1b9b-445c-a7f7-2fad5ada3fec None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.061585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 250/491] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:52.063122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.073203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06431a6-1b9b-445c-a7f7-2fad5ada3fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-c06431a6-1b9b-445c-a7f7-2fad5ada3fec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:52.081043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:52.082109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:52.083084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 242/492] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:52.088108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4611ab-a3d0-4c10-80c3-5c0f828d86c4 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.088397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4611ab-a3d0-4c10-80c3-5c0f828d86c4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.088681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4611ab-a3d0-4c10-80c3-5c0f828d86c4 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.089996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 243/493] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:52.090675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4611ab-a3d0-4c10-80c3-5c0f828d86c4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.176463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33588-b197-4f9c-a655-ebc5c560e0a0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.199827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4611ab-a3d0-4c10-80c3-5c0f828d86c4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.200035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.213897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.214837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.215296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.215722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.216736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:52.217193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.218718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.231729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 251/494] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:52.232680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.240186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636db2b2-5323-4cb5-8311-096144baa34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.240983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db2b2-5323-4cb5-8311-096144baa34f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.241264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db2b2-5323-4cb5-8311-096144baa34f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.241538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db2b2-5323-4cb5-8311-096144baa34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.254580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636db2b2-5323-4cb5-8311-096144baa34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.256075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636db2b2-5323-4cb5-8311-096144baa34f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.257932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-636db2b2-5323-4cb5-8311-096144baa34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:52.274051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:52.274954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:52.275868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:52.275868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:52.275868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:52.275868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:52.275868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 244/495] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:52.276534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118d72d-160d-4da9-8cfd-17f6ee57bc97 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.276771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118d72d-160d-4da9-8cfd-17f6ee57bc97 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.277056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118d72d-160d-4da9-8cfd-17f6ee57bc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.294383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8118d72d-160d-4da9-8cfd-17f6ee57bc97 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:52.295597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8118d72d-160d-4da9-8cfd-17f6ee57bc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:52.334347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b876286-8a13-4d73-ad9f-e8d70498574d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.361851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 245/496] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:52.362684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118d72d-160d-4da9-8cfd-17f6ee57bc97 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.374741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f1471-e27a-4042-8341-e98d196eba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.375446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f1471-e27a-4042-8341-e98d196eba46 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.375738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f1471-e27a-4042-8341-e98d196eba46 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.376020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f1471-e27a-4042-8341-e98d196eba46 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.376768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f1471-e27a-4042-8341-e98d196eba46 None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:52.377079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f1471-e27a-4042-8341-e98d196eba46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.378467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f1471-e27a-4042-8341-e98d196eba46 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.387546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 252/497] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:52.388776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4612d1-d963-4dcc-9b70-a51201f3a244 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.389070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4612d1-d963-4dcc-9b70-a51201f3a244 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.389359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4612d1-d963-4dcc-9b70-a51201f3a244 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.390583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 253/498] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:52.391607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4612d1-d963-4dcc-9b70-a51201f3a244 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.437581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.463810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118d72d-160d-4da9-8cfd-17f6ee57bc97 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.488793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.493680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4612d1-d963-4dcc-9b70-a51201f3a244 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.499583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.500367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.500657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.500932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.507922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.509357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:33:52.524823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:52.525739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:33:52.526641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:52.527169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.527169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.527891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.528171 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.528892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:52.529204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.530589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.530972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 246/499] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:52.531760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.544960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 254/500] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:52.545758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.626504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a67f-8c99-4f1f-9c85-e3c9ef59497f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.646012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5894-392c-45df-aa80-e8ad534bfcb9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.648268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.660392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada14b-6727-4ae9-a2cc-8a001f8c4e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.661173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada14b-6727-4ae9-a2cc-8a001f8c4e60 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.661458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada14b-6727-4ae9-a2cc-8a001f8c4e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.661738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada14b-6727-4ae9-a2cc-8a001f8c4e60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.671501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ada14b-6727-4ae9-a2cc-8a001f8c4e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-06ada14b-6727-4ae9-a2cc-8a001f8c4e60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:52.679092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:52.679990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:52.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 247/501] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:52.686454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.686547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a5762-2020-4f32-b38c-bd02bbed2747 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.686547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a5762-2020-4f32-b38c-bd02bbed2747 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.686547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a5762-2020-4f32-b38c-bd02bbed2747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.686725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.686725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.686725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.693017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.694436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.697766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-912a5762-2020-4f32-b38c-bd02bbed2747 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:52.698938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-912a5762-2020-4f32-b38c-bd02bbed2747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:52.712211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:52.713272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:52.714358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:52.714358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:52.714358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:52.714358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:52.714358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 255/502] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:52.714358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.741898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.768925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 248/503] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:52.769724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a5762-2020-4f32-b38c-bd02bbed2747 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.819759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce11e6-f22f-4f80-bf3b-e3b5b758e3a2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.853115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.853771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.854052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.854326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.855149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:52.855491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.856918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.867026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a5762-2020-4f32-b38c-bd02bbed2747 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:52.891885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 256/504] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:52.892690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.901638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:52.903035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:52.903350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:52.903630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:52.909467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.910683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:52.912307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:33:52.926940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:52.928034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:52.928965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 249/505] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:52.929544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:52.961841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:52.995189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2f5b-0ed1-4fd3-8c5e-578f29c4ad98 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.026270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf467-0a78-459a-bb15-3e92c72c6309 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.028498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.029164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.029449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.029732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.030482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:53.030796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.032235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.039957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 257/506] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:53.040768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.060018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.060830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.061112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.061388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.062104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:53.062409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.063798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.075199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 250/507] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:53.075995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.120893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.145118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b367-0cdf-42c4-a2ee-17e8e8692b2f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.167541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.174369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bb11f-fa7e-43e9-8b4e-756a8bcb1a4a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.178046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.178836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.179124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.179435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.190119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.191613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.207952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.208592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.208904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.209183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:53.209277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:53.210141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:53.210989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:53.210989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:53.210989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:53.210989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:53.210989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 258/508] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:53.211285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.277598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.278998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.311765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235d7d-beb0-4162-9c7f-a4c0b630b053 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.336799 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.345011 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.345699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.345985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.346263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.347086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:53.347421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.348841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.365048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 259/509] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:53.365838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.373470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.381425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 251/510] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:53.382215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.466036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f49b7-73ae-44d6-a111-3ff557ea7430 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.486748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841315-d0a2-4247-8921-55780154bc5b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.501199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.501994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.502281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.502559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.512367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.513824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.520431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.521220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.521510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.521791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.528822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.530197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:53.531369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:53.532328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:53.533231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:53.533231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:53.533231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:53.533231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:53.533231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 260/511] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:53.533503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:33:53.549827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:53.550891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 252/512] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:53.551845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.574400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.608588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.632744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8507c7-86e1-409d-a5d1-1f1cd11c2549 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.652762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd9c9-6793-445f-857b-a36f2669abb3 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.664965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.665619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.665904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.666187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.666902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:53.667230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.669101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.679935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 261/513] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:53.680515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.690080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.690727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.691017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.691331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.762257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.763957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.790963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.796569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427b36-79c5-4979-9588-4dfe9de55da2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.821487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:53.830461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.831376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.831672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.831957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:53.842930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:53.844469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:53.861528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:53.862398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:53.863282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:53.863282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:53.863282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:53.863282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:53.863282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 262/514] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:53.863558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.868265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 253/515] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:53.868975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:53.965971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbbe55-83a3-41ff-8cd9-245d6144cfd2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.966173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fff4b-1eb6-42cb-b1cc-be8b73d3697c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:53.998606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.999296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:53.999584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:53.999797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:53.999902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.000492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.000591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:54.000776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.000873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.001052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.001886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:54.002196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.002279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.003654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.014304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 263/516] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:54.015071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.028334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.040103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 254/517] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 23 13:33:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:54.040935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.055089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.126229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763227f7-19a4-4e0c-ae96-6dc341458f76 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.141827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99618a48-e43a-40c0-8f33-e9aca91ae847 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.161201 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.161866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.162156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.162436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.163130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.164596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.174745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.175390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.175676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.175961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.176762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:54.177218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.178676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.183535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 264/518] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:33:54 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:33:54.184337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.203021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 255/519] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:54.208302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.258338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.295082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.300370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c62c8d-22e5-4f1a-bef6-d9a475dc160e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.327635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba654-881c-4d62-b609-f18f839ac0db None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.341028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.341825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.342111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.342386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.353712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.355172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.368085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.369557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.369557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.369557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:54.375052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:54.375976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:54.376844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:54.376844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:54.376844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:54.376844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:54.376844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 265/520] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:54.377520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.380827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.383808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:33:54.402598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:54.403595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 256/521] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:54.409333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.490775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2266b-7937-4a2f-99a2-594b426461dd None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.509306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d13f-8087-412d-bc7f-367ddf89ad96 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.510189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.528946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.529595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.529880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.530157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.540073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.547011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.548073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.548434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.548783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.557640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.559134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:33:54.573846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:54.574753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:54.575656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 257/522] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:54.576130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.607661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.609374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.680540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458b9c-199b-44d2-898c-d593c097089a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.717609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.718636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.718926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.719332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.720064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:54.720373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.721759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.722851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 266/523] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:54.724105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.734952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 258/524] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:54.736538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.743941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.796857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:54.833287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339c5fd-f8a8-4aed-a244-af03983f4c55 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.846517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8833ca-a49a-43ab-a967-353bf0337197 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:54.869649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.870245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.870539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.870820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.872292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:54.872602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.874057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.882518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:54.883291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:54.883583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:54.883862 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:54.884643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:54.884951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:54.886364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:54.897519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 267/525] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:54.897519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.905660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 259/526] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:54.910427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:54.980242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:55.005258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988f00-3341-4fa6-a5ba-97aea0631d66 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.011604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026461a8-1de9-4023-af7c-13630f82b37d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.024878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:55.039586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.040400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.040673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.040948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.050703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.051547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.051842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.052076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.052195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.053555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.059843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.061323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:55.074659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:55.075569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:55.076446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:55.076446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:55.076446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:55.076446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:33:55.076661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:55.077413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:55.079061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:55.080047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 268/527] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:55.080207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 260/528] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:55.080207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.084791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.182275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746732-d929-4182-a749-ae2d0ba21013 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.186658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b21bb-4226-4a62-bba4-cc6d36dfb693 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.215087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:55.224153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.224803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.225090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.225366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.227595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.228243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.228527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.229419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.229624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=c37e7d70e2864edaa125e8f5ac1a3373) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:55.229932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.231888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.247643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 261/529] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/role_assignments?user.id=c37e7d70e2864edaa125e8f5ac1a3373&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:55.249677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.309444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.310949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.323630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:55.403007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185490-21b3-4404-b47e-0925de43220c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.436131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 269/530] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:55.437012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.438284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.438953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.439284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.439577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.440310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:55.440625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.442009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.459548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 262/531] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:55.460431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.469487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:55.551668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cb8c2-87ab-4a7b-8fa3-95c5f44862d5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.559621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:55.565338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed9bab-5677-492f-820c-52857ac20974 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.590685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.591609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.592104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.592549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.593479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:55.593981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.595595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.600512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.601317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.601610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.601896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.612611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.614125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.620823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 270/532] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:55.622390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:55.633290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:55.634341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:55.635405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:55.635405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:55.635405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:55.635405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:55.635405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 263/533] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:55.635865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.718054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:55.730740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95150f-0b0f-4a9f-9075-af2ad9e85709 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.750310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25679da8-4dca-4ae6-b47e-73622e62f013 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:55.767543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.768670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.769026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.769380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.778881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.780614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.788942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:55.789817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:55.790282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:55.790802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:55.791855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=e54dc244053a4253aa32f1eebd655589) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:55.792348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:55.793987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:33:55.797611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:55.798453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:55.799357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 271/534] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:55.800811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.802668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 264/535] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/role_assignments?user.id=e54dc244053a4253aa32f1eebd655589&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:55.811331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:55.842501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:56.006947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b40a7-c533-47dd-b02e-38984af5e3a8 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:56.013659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876aa9-323c-486e-b708-fed0e0eeedb0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:56.051815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:56.052509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.052797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.053197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.054183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:56.054379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:56.056033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:56.068459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 265/536] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:33:56.069279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:56.069965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.070252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.070529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.075255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:56.075255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:56.075255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:56.076644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:56.086311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 272/537] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:56.092664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:56.106790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:56.156901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:56.188163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96df12-da75-4fc8-bf7e-e5a14a4d0125 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:56.226092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd94b25-53d1-449e-aa3e-597e5432ada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:56.227172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94b25-53d1-449e-aa3e-597e5432ada0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.227741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94b25-53d1-449e-aa3e-597e5432ada0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.228218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94b25-53d1-449e-aa3e-597e5432ada0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.229269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd94b25-53d1-449e-aa3e-597e5432ada0 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=f98ec37cbc1f4da88cc2d7887b26aa41) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:56.230002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd94b25-53d1-449e-aa3e-597e5432ada0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:56.232278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd94b25-53d1-449e-aa3e-597e5432ada0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:56.238741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 266/538] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:56 2022] GET /identity/v3/role_assignments?user.id=f98ec37cbc1f4da88cc2d7887b26aa41&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:56.310721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c78f56-ce9f-4d31-89ff-451d496dc8ba None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:56.343999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5b26-f561-4342-82b2-7b2dd057fe69 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.344705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5b26-f561-4342-82b2-7b2dd057fe69 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.345188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5b26-f561-4342-82b2-7b2dd057fe69 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.346773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 267/539] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:56.353773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859eaa-6c39-41c8-93e3-8c4ae8694c72 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.354640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859eaa-6c39-41c8-93e3-8c4ae8694c72 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.355131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859eaa-6c39-41c8-93e3-8c4ae8694c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.364358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:56.365267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.365559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.365839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.381545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-73859eaa-6c39-41c8-93e3-8c4ae8694c72 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:56.383163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-73859eaa-6c39-41c8-93e3-8c4ae8694c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:56.383939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:56.385436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:33:56.408396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:56.409333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:56.410184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:56.414221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 273/540] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:56.415753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:56.468243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 268/541] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:56.500551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859eaa-6c39-41c8-93e3-8c4ae8694c72 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:56.539740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:56.578847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:56.599981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6ea10-a012-4db2-a1b0-852da207bf22 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:56.632930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859eaa-6c39-41c8-93e3-8c4ae8694c72 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:56.661844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:56.662512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.662802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.663083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.663912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:56.664228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:56.665685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:56.685359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 274/542] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:56.694618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:56.695518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.695800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.696074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.696194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:56.707117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:56.716851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:56.717776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:56.718724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 269/543] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:56.725398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:56.817554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94756255-1f02-4aa0-996f-efd75a09b7ed None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:56.849000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:56.853683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:56.854339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:56.855471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:56.855471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:56.856133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=45c718c1e1024d73b6b635f77bacdbed) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:56.856451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:56.858102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:56.867547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 275/544] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:33:56 2022] GET /identity/v3/role_assignments?user.id=45c718c1e1024d73b6b635f77bacdbed&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:56.969684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002482e-2cd1-40ae-8889-948f9f460d65 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:57.005763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:57.021766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:57.022452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.022743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.023072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.023815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:57.024131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:57.025520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:57.034992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 270/545] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:57.040385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:57.150447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4056418-909a-4e73-b2c9-3e0983786133 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:57.188958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:57.190080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.190557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.191046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.206062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:57.207909 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:57.235102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:57.236132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:57.236977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:57.236977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:57.236977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:57.236977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:57.239353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 276/546] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:57.244807 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:57.372481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064cf5-dc81-4178-9fd4-92a6a35341e8 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:57.424375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:57.424964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.425256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.425540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.426266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:57.426579 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:57.427980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:57.440679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 271/547] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:57.445813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:57.529792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:57.592443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2a635-b1c6-4403-882b-25114e8d8d70 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:57.633179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90843ae0-feeb-491e-8c2c-b30366a9f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:57.633977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90843ae0-feeb-491e-8c2c-b30366a9f33a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.634263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90843ae0-feeb-491e-8c2c-b30366a9f33a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.634542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90843ae0-feeb-491e-8c2c-b30366a9f33a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.641969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90843ae0-feeb-491e-8c2c-b30366a9f33a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:57.643458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90843ae0-feeb-491e-8c2c-b30366a9f33a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-90843ae0-feeb-491e-8c2c-b30366a9f33a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:33:57.659567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:57.660727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:33:57.662307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:57.665304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 277/548] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:33:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:57.666631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:57.731980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6677-d92c-4986-b84d-4121cdc0c580 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.732276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6677-d92c-4986-b84d-4121cdc0c580 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.732459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6677-d92c-4986-b84d-4121cdc0c580 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.734082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 278/549] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:33:57.737314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:57.744351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f766e-5c82-4ec7-8606-2a4d7c441906 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.744641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f766e-5c82-4ec7-8606-2a4d7c441906 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.744920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f766e-5c82-4ec7-8606-2a4d7c441906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.765736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9e6f766e-5c82-4ec7-8606-2a4d7c441906 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:57.767195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9e6f766e-5c82-4ec7-8606-2a4d7c441906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:57.829628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ab94e-9c9d-4ff2-9ffe-21c0abadf16d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:57.889292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 279/550] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:33:57.891490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:57.892164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:57.892448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:57.892726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:57.893564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:57.893878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:57.895337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:57.919314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 272/551] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 23 13:33:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:57.924854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f766e-5c82-4ec7-8606-2a4d7c441906 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:57.937430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:57.995654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:58.111549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f766e-5c82-4ec7-8606-2a4d7c441906 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.126268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00e0c1-aef9-4b53-9bd4-75eec6b4ac80 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.139337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:58.182729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7925d3-9ddf-48e8-acf8-5ef0e401d1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:58.183733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7925d3-9ddf-48e8-acf8-5ef0e401d1b4 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.184630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7925d3-9ddf-48e8-acf8-5ef0e401d1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.185060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7925d3-9ddf-48e8-acf8-5ef0e401d1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.210386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:58.211199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.211516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.211841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.236461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:58.244489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:58.246767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:58.247773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 273/552] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:33:58.255528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:58.350162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7925d3-9ddf-48e8-acf8-5ef0e401d1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:58.351675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7925d3-9ddf-48e8-acf8-5ef0e401d1b4 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:58.398523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02176d1-788b-418c-af2f-93d18842b911 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.437548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:58.438594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.438880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.443008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.443008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:58.443008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:58.443008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:58.451439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:58.474655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 274/553] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:58.484650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:58.539438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:58.551895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 280/554] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:33:58.553331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32e36-3899-4da9-b79a-603e5181dcb9 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.553724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32e36-3899-4da9-b79a-603e5181dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.554078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32e36-3899-4da9-b79a-603e5181dcb9 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.555707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 281/555] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:58.561774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa6fe-3c46-44d8-8982-7ef86a6663f6 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.562072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa6fe-3c46-44d8-8982-7ef86a6663f6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.562356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa6fe-3c46-44d8-8982-7ef86a6663f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.580371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f4afa6fe-3c46-44d8-8982-7ef86a6663f6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:58.581547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f4afa6fe-3c46-44d8-8982-7ef86a6663f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:58.623885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc68ab-d233-4cb9-8bc7-dc5bd12b3555 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.659236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 282/556] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:58.659236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa6fe-3c46-44d8-8982-7ef86a6663f6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:58.669564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42414e-997b-4067-a93d-5f1565002b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:58.670615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42414e-997b-4067-a93d-5f1565002b09 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.670904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42414e-997b-4067-a93d-5f1565002b09 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.671455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42414e-997b-4067-a93d-5f1565002b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.685437 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42414e-997b-4067-a93d-5f1565002b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:58.686877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42414e-997b-4067-a93d-5f1565002b09 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-aa42414e-997b-4067-a93d-5f1565002b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:58.704973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:58.706066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 275/557] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137655cf-0b2f-49d3-88da-92e15e1956bb None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137655cf-0b2f-49d3-88da-92e15e1956bb None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137655cf-0b2f-49d3-88da-92e15e1956bb None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.712037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 276/558] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:58.712589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137655cf-0b2f-49d3-88da-92e15e1956bb None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:58.725454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:58.769489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa6fe-3c46-44d8-8982-7ef86a6663f6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.804322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:58.808251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:58.809654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.810041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.810365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.823049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:58.824564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:58.829564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137655cf-0b2f-49d3-88da-92e15e1956bb None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:58.842374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:58.848734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:58.849611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:58.849611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:58.849611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:58.849611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:58.849611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 283/559] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:58.849611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:58.870704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080314fa-4ef1-40fc-a0bd-9ee0bbd2ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:58.872158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080314fa-4ef1-40fc-a0bd-9ee0bbd2ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.872449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080314fa-4ef1-40fc-a0bd-9ee0bbd2ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.872729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080314fa-4ef1-40fc-a0bd-9ee0bbd2ffe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.883774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080314fa-4ef1-40fc-a0bd-9ee0bbd2ffe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-080314fa-4ef1-40fc-a0bd-9ee0bbd2ffe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:58.891743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:58.892677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 277/560] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:58.899132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46846383-aa45-4ac7-a22b-f2af9ee3fdb4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:58.900169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46846383-aa45-4ac7-a22b-f2af9ee3fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:58.900169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46846383-aa45-4ac7-a22b-f2af9ee3fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:58.915484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-46846383-aa45-4ac7-a22b-f2af9ee3fdb4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:58.916855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-46846383-aa45-4ac7-a22b-f2af9ee3fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:58.964586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bf22-7638-4e3a-bd7f-5057ca176abe None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:58.981661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:58.989533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 278/561] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:58.990616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46846383-aa45-4ac7-a22b-f2af9ee3fdb4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.007675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.008638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.009069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.009563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.010435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:59.010889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.012631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.024848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 284/562] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:59.025828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.072518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.107126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46846383-aa45-4ac7-a22b-f2af9ee3fdb4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.129746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f899f2-b471-4efa-a06a-271f2955ed4d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.143130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.143842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.144130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.144678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.145134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:59.145445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.146816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.163115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 279/563] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:59.163115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.173096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.173767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.174055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.174335 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.175080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:59.175421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.176794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.185130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 285/564] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:59.186217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.228971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.268287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedf8c5-6598-45cc-896b-f601bb3c9b49 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.291054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3ad40-1efc-4181-8aa0-564ffa3c8c7b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.297380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.303732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.304527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.304819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.305098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.315233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:33:59.322940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:59.323952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:33:59.324806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:59.325508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.325604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 280/565] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:59.325676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.325676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.325796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.325870 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.336313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.337773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:33:59.351828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:59.352786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 286/566] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:59.353731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.432261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b2fc-45dd-4b1c-92f3-8379fd103206 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.445417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.449967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81dba9-f614-448a-ac50-1e58355a52e7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.466812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dc2c5-0e50-44cf-8372-b3850c5e6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.467632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dc2c5-0e50-44cf-8372-b3850c5e6eba None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.467919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dc2c5-0e50-44cf-8372-b3850c5e6eba None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.468198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dc2c5-0e50-44cf-8372-b3850c5e6eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.474859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dc2c5-0e50-44cf-8372-b3850c5e6eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.476352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dc2c5-0e50-44cf-8372-b3850c5e6eba None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.485170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.485965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.486255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.486539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-053dc2c5-0e50-44cf-8372-b3850c5e6eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:33:59.490896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:59.491944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 281/567] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b33f-c24d-4d5a-b47f-92683f075675 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.498429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b33f-c24d-4d5a-b47f-92683f075675 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.499173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b33f-c24d-4d5a-b47f-92683f075675 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.499173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 282/568] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:33:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:33:59.499173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b33f-c24d-4d5a-b47f-92683f075675 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.504208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.505684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:59.523112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:59.524196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:59.525172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:59.525172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:59.525172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:59.525172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:33:59.525172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 287/569] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:59.525172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.550332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.600663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b33f-c24d-4d5a-b47f-92683f075675 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.627024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ea31-7e0d-49f8-970a-d60e4b224bd4 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.634060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.634720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.635008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.635319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.636064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:59.636374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.637757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.645779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 283/570] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:59.646709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.663634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35d2e7-c7b5-4ec0-971a-b2d01d5cb566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.664301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35d2e7-c7b5-4ec0-971a-b2d01d5cb566 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.664576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35d2e7-c7b5-4ec0-971a-b2d01d5cb566 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.664858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35d2e7-c7b5-4ec0-971a-b2d01d5cb566 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.665683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35d2e7-c7b5-4ec0-971a-b2d01d5cb566 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:59.665996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35d2e7-c7b5-4ec0-971a-b2d01d5cb566 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.667448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35d2e7-c7b5-4ec0-971a-b2d01d5cb566 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.684910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 288/571] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:59.686076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f035-5fc1-4739-b29a-4a0a8158a684 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.686363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f035-5fc1-4739-b29a-4a0a8158a684 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.686637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f035-5fc1-4739-b29a-4a0a8158a684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.702485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-89f2f035-5fc1-4739-b29a-4a0a8158a684 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:33:59.703706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-89f2f035-5fc1-4739-b29a-4a0a8158a684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:33:59.705616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.752948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e8517-13be-4923-98bf-6e154b5add82 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.765772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.779340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 289/572] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:33:59.779340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2f035-5fc1-4739-b29a-4a0a8158a684 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.786341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.787007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.787330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.787615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.788401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:59.788715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.790150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.802111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 284/573] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:59.802895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.884042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2f035-5fc1-4739-b29a-4a0a8158a684 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.900395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739b8d-6431-47af-a7fb-03889215971e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:33:59.917469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.918198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.918485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.918764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.919521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:33:59.919839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.921213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.927399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:59.933016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 290/574] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:33:59.934314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.934555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:33:59.935318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:33:59.935617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:33:59.935899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:33:59.946281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:33:59.947761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:33:59.965853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:33:59.966913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:33:59.972865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:33:59.972865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:33:59.972865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:33:59.972865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:33:59.972865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 285/575] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:33:59.972865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:33:59.996823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.032048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66a713-ea91-46ca-a6b7-8d54fa39cbbc None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.065808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.066591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.066878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.067149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.069621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44eaae-de86-4147-a0b8-9ad1982f1458 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.078463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.079944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:00.096524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:00.097453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:00.098355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:00.098355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:00.098355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:00.098355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:00.098355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 291/576] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:00.098638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.107825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.108625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.108911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.109187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.119139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:00.127324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:00.128425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:00.129332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 286/577] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:00.130035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.148862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.198169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d0783-7b11-4310-85bd-12dd88a92ed7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.214975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.232320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a88f-41b0-4431-8d1f-d754b44b4939 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.232763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.233419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.233709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.233987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.234810 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=edc00ecebf0c451b94b56e3e97254010) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:00.235125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.236600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.241918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 292/578] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/role_assignments?user.id=edc00ecebf0c451b94b56e3e97254010&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:00.242684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.269186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.270172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.270459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.270859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] PATH_INFO: `/v3/users/glance` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.280135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.281708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:00.298229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:00.299388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:34:00.300421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:00.303551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 287/579] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:00.304681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.356452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d84b-f067-4d07-9d9b-5db253a44a20 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.372537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.396352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.397027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.397319 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.397605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.398457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:00.398774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.400270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.413362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a810e6f-e0fe-454d-983c-bf23bbfa697a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.413791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 293/580] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:00.414624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.454987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.455793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.456080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.456359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.457078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:00.457512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.458993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.475256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 288/581] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:00.476501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.486777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.522072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dafc6-5684-4453-8284-bcc61003a324 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.558958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.559666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.559951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.560227 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.561003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:00.561313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.562694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.575483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 294/582] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:00.575483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.593832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f2da-d321-495f-9977-37d2a62a9402 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.609139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.630464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.631140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.631462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.631896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.632614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:00.632928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.634366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.653006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 289/583] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:00.653567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.681557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1c20d-ee3f-4a9a-b2c2-dd39fc420789 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.715128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d1842-2713-4645-8443-b169459c6023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.715953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d1842-2713-4645-8443-b169459c6023 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.716235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d1842-2713-4645-8443-b169459c6023 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.716516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d1842-2713-4645-8443-b169459c6023 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.719795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.726035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d1842-2713-4645-8443-b169459c6023 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.727999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d1842-2713-4645-8443-b169459c6023 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-545d1842-2713-4645-8443-b169459c6023 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:00.742841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:00.744148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:34:00.745315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:00.748608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 295/584] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:00.749163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d1842-2713-4645-8443-b169459c6023 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.767450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ecbb-d0fa-4338-a693-5cbc164ad8ff None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.806287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.807214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.807605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.807984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.815289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.816848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:00.830873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:00.831957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:00.833052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:00.838858 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 290/585] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:00.838858 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.853503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.861715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d1842-2713-4645-8443-b169459c6023 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.900287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.901327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.902022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.903213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.914599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.916102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:00.934336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:00.935256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:00.936173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:00.936173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:00.936173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:00.936173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:00.936173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 296/586] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:00.936456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:00.944297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f421b9-0bda-4ab6-a373-eb64811ee88a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:00.967990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:00.981125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:00.981923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:00.982207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:00.982483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:00.993420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:00.994853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:01.013043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:01.013929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:01.014808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:01.014808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:01.014808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:01.014808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:01.014808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 291/587] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:01.015090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.060946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c80b48-f6b0-4942-82cd-e44aeedafa81 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.097518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.098188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.098475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.098756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.099615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:01.100099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.101669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.117243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b6191-7702-46f5-91e2-0c75b8a4da2b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.120161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 297/588] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 23 13:34:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:01.120682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.128860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:01.161098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.161734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.162020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.162534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.163275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:01.163594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.165136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.183717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 292/589] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:01.184474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.223492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:01.223805 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660139-6234-4adb-be31-c3b01b3854a2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.260432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.261098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.261457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.262269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.263220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:01.263541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.264917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.277469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 298/590] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:01.278537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.300157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c82b-c0d6-4043-9327-69f6082ae747 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.336024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.336698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.336985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.337261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.338000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:01.338307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.340262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.352418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 293/591] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:01.353077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:01.355240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.390792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a34935-2356-4fce-908b-5066c76b89b7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.428516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.429291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.429580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.429855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.440710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.442168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.454712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:01.460494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:01.461395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:01.462282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:01.462282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:01.462282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:01.462282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:01.462282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 299/592] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:01.462564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.468519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa991440-1c7d-4bf7-b1ed-964f2b4b4697 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.503505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.504397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.504683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.504961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/c37e7d70e2864edaa125e8f5ac1a3373/roles/fae6b286f5584beb868e5087cbf3d351` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.519448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=c37e7d70e2864edaa125e8f5ac1a3373, role_id=fae6b286f5584beb868e5087cbf3d351)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.520886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.534875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 294/593] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:01 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/c37e7d70e2864edaa125e8f5ac1a3373/roles/fae6b286f5584beb868e5087cbf3d351 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:01.535925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.590830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1cf4e-a41f-4de0-b0b1-bdc87eab470c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.611662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:01.635523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.637154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.637562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.637851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.649695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.651689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:01.675884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:01.676923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:34:01.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:01.680216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e47a2b-60bf-4165-9c19-759279bbf056 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.681906 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 300/594] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:01.683271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.735387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.736860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.737397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.737808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.750113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.751886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:01.773197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:01.774162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:01.775054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:01.776691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 295/595] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:01.781540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.788622 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:01.806014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4a684-a62f-41af-add0-162531cd60f5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.844256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.845289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.845823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.846412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.847473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:01.848004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.849664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.862850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 301/596] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:01.864147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.905868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34efa76-0729-42df-9880-4bc870efc9ea None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:01.907639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:01.944666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:01.945574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:01.946006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:01.946525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:01.947589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:01.948098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:01.949983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:01.969217 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 296/597] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:01.970533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:01.972562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6f49d-09c9-43a9-8a47-5a07acd26c83 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.010180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.010690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.010976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.011278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.012090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:02.012398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.013841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.031484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 302/598] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:02.032505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.043630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.084352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17bb6a-0a09-4ecf-8408-6c1487275478 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.131640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.133044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.133741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.134232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.136075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.138029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4994a8-b2e8-4945-990c-b30383ddd8ab None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.145995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.148366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:02.167119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:02.168705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 297/599] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:02.170218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.185745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.187461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.187903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.188360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.204289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.207130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:02.229257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:02.231001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:02.232178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:02.232178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:02.232178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:02.232178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:02.238063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 303/600] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:02.239001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.284843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecc983-d734-4f7c-8c44-4a006cc25340 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.309603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.322427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.323614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.324707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.325166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/e54dc244053a4253aa32f1eebd655589/roles/fae6b286f5584beb868e5087cbf3d351` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.341625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=e54dc244053a4253aa32f1eebd655589, role_id=fae6b286f5584beb868e5087cbf3d351)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.343155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.363299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 298/601] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:02 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/e54dc244053a4253aa32f1eebd655589/roles/fae6b286f5584beb868e5087cbf3d351 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:02.363299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.368009 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325c91-2791-45da-a533-d931c86b2e1a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.407137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e1140-33ae-4a20-93a2-f40e0fdfed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.407945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1140-33ae-4a20-93a2-f40e0fdfed21 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.408308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1140-33ae-4a20-93a2-f40e0fdfed21 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.408705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1140-33ae-4a20-93a2-f40e0fdfed21 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.409640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e1140-33ae-4a20-93a2-f40e0fdfed21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:02.410021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e1140-33ae-4a20-93a2-f40e0fdfed21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.411796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e1140-33ae-4a20-93a2-f40e0fdfed21 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.430780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 304/602] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:02.432462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48d03f-ecf2-4ad1-af1f-45683c2efe03 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.432978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48d03f-ecf2-4ad1-af1f-45683c2efe03 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.433475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48d03f-ecf2-4ad1-af1f-45683c2efe03 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.439310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 305/603] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:02.439310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48d03f-ecf2-4ad1-af1f-45683c2efe03 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.451415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.515233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438a76c-96bf-43c9-a802-329885d47525 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.557392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ee2c7-8d56-453a-a510-27b810cd91f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.558092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee2c7-8d56-453a-a510-27b810cd91f1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.558989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee2c7-8d56-453a-a510-27b810cd91f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.559309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee2c7-8d56-453a-a510-27b810cd91f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.560043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ee2c7-8d56-453a-a510-27b810cd91f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:02.560355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ee2c7-8d56-453a-a510-27b810cd91f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.561724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ee2c7-8d56-453a-a510-27b810cd91f1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.566546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48d03f-ecf2-4ad1-af1f-45683c2efe03 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.573555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 299/604] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:02.574836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c605-0228-47a6-a685-ddbe76c5ef70 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.575127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c605-0228-47a6-a685-ddbe76c5ef70 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.577066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c605-0228-47a6-a685-ddbe76c5ef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.593991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9301c605-0228-47a6-a685-ddbe76c5ef70 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:02.595181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9301c605-0228-47a6-a685-ddbe76c5ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:02.604795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.606895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.607527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.607809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/f98ec37cbc1f4da88cc2d7887b26aa41/roles/fae6b286f5584beb868e5087cbf3d351` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.627012 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.634076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=f98ec37cbc1f4da88cc2d7887b26aa41, role_id=fae6b286f5584beb868e5087cbf3d351)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.635564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.657648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 306/605] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:02 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/f98ec37cbc1f4da88cc2d7887b26aa41/roles/fae6b286f5584beb868e5087cbf3d351 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:02.658936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.711016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 300/606] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:02.748845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c605-0228-47a6-a685-ddbe76c5ef70 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.768512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.841168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291b5c4-08ce-482d-9aa9-73538f69e370 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.880568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.881756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.882263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.882756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.890649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:02.892473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:02.908673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:02.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:02.910742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 307/607] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:02.915399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:02.942345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c605-0228-47a6-a685-ddbe76c5ef70 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:02.979530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:02.980362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:02.980646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:02.980921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:02.993415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:03.002280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:03.003474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:03.004526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 301/608] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:03.009782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.029625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671f13-d058-4735-accf-d65efbf16422 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.043623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:03.050905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:03.081306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.082124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.082531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.082908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.083836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:03.084255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.085984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.114115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 308/609] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:03.115328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.123174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9a71-a760-4b06-9979-47298bf8d3e0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.159336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.160286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.160827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.161260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.162146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:03.162681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.164268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.173245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 302/610] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:03.178883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.279708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:03.287768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565333ee-ad17-408b-9d83-89414ef2fbc2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.340323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.341782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.342210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.342626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.358755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.361071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.367340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac33fa-bb30-4603-b0a8-a59ed65b1327 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:03.394703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:03.395871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:03.396955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:03.396955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:03.396955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:03.396955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:03.409178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 303/611] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:03.411518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.437107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.438259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.438718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.439157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/45c718c1e1024d73b6b635f77bacdbed/roles/fae6b286f5584beb868e5087cbf3d351` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.478874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=45c718c1e1024d73b6b635f77bacdbed, role_id=fae6b286f5584beb868e5087cbf3d351)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.481120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.518624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 309/612] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:03 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/45c718c1e1024d73b6b635f77bacdbed/roles/fae6b286f5584beb868e5087cbf3d351 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:03.535310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155d4f5-8074-489b-94e0-8f09976940b1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.573196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.573918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.574213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.574498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.575264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:03.575586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.576982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.579843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:03.592208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 304/613] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:03.597557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.650910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:03.748037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb3d23-ca24-4233-83c8-156f60bfd4f1 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:03.798003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883dbc-a989-4fde-a039-3b4eee344460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:03.798750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883dbc-a989-4fde-a039-3b4eee344460 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.799037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883dbc-a989-4fde-a039-3b4eee344460 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.799345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883dbc-a989-4fde-a039-3b4eee344460 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.814462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883dbc-a989-4fde-a039-3b4eee344460 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:03.815972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883dbc-a989-4fde-a039-3b4eee344460 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-d0883dbc-a989-4fde-a039-3b4eee344460 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:03.834322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:03.835386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:03.836339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 310/614] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:03.841109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:03.855328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ffcf-5665-4246-a4e5-1c8051387162 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.855844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ffcf-5665-4246-a4e5-1c8051387162 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.856273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ffcf-5665-4246-a4e5-1c8051387162 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.858038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 311/615] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:03.862968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bf846-041b-40e1-96ae-d9be81ebd96a None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:03.863292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bf846-041b-40e1-96ae-d9be81ebd96a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:03.863576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bf846-041b-40e1-96ae-d9be81ebd96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:03.883600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2d1bf846-041b-40e1-96ae-d9be81ebd96a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:03.885134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2d1bf846-041b-40e1-96ae-d9be81ebd96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:03.979737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef218875-306c-400e-9a2a-d83d585fc50d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.023057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 312/616] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:34:04.037543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.038496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.038955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.039408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.040474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:04.040953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.043114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:04.070838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 305/617] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 23 13:34:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:04.076126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bf846-041b-40e1-96ae-d9be81ebd96a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.091683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.101115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:04.187662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bf846-041b-40e1-96ae-d9be81ebd96a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.224783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.225632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.225920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.226198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.236259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:04.238735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.240276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:04.260331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:04.261266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:04.262797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:04.262797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:04.262797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:04.262797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:04.262797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 313/618] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:04.269716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.296377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917894d-aa54-40b0-ac70-066d1bed39b0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.334630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.336636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.341772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.342695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.360514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:04.369561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:04.370590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:04.372032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:04.381277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 306/619] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:04.387768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.399532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:04.456931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2b00f-ed9c-4f91-bce6-030979c4c810 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.491326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f1cf2-afbf-4391-950b-0b8ce615398d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.493087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.494024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.494526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.495006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.496508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:04.497046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.498671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:04.506730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:04.513643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 314/620] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:04.522547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.538720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.538720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.538720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.538720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.539121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:04.539121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.539121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:04.550698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 307/621] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:04.556439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.675160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696e02-dfae-4557-bf14-482461e18fce None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.682900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190ef9-736b-43bf-a5be-ff44b8531a2d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.717567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.718760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.719297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.719776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.740377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.742892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:04.751014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:04.762196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.763017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.763338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.763625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:04.772510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:04.773433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:04.774768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:04.774768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:04.774768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:04.774768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:04.774768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 308/622] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:04.779595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.787499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.793101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:04.815449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:04.816385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:04.817303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:04.827963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 315/623] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:04.834538 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:04.842933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:04.941885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2406894-cc0e-4855-8c35-1b1d08f53e00 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.981368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1712-e13e-4222-a604-b0ca250c7998 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:04.988052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:04.988758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:04.989055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:04.989344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:04.990164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:04.990483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:04.992036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:05.020204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 316/624] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:05.021474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.039791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f65a63-b08b-4fa3-8361-a28eeacc0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.040532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f65a63-b08b-4fa3-8361-a28eeacc0fae None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.040824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f65a63-b08b-4fa3-8361-a28eeacc0fae None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.041183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f65a63-b08b-4fa3-8361-a28eeacc0fae None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.042053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f65a63-b08b-4fa3-8361-a28eeacc0fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:05.042367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f65a63-b08b-4fa3-8361-a28eeacc0fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:05.044483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f65a63-b08b-4fa3-8361-a28eeacc0fae None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:05.062377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 309/625] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:05.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92bec0-b6e8-45e2-80e0-1a614816b8d6 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.064090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92bec0-b6e8-45e2-80e0-1a614816b8d6 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.064373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92bec0-b6e8-45e2-80e0-1a614816b8d6 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.065898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 310/626] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:05.066592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92bec0-b6e8-45e2-80e0-1a614816b8d6 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.082272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:05.132059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5b48-f30d-4ce9-8713-546d5c8a2910 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:05.166947 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c119e0-5b4f-414b-9a9d-9a8474db679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.168414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c119e0-5b4f-414b-9a9d-9a8474db679e None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.168707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c119e0-5b4f-414b-9a9d-9a8474db679e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.168998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c119e0-5b4f-414b-9a9d-9a8474db679e None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/edc00ecebf0c451b94b56e3e97254010/roles/fae6b286f5584beb868e5087cbf3d351` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.172740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:05.183706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c119e0-5b4f-414b-9a9d-9a8474db679e None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=edc00ecebf0c451b94b56e3e97254010, role_id=fae6b286f5584beb868e5087cbf3d351)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:05.185178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c119e0-5b4f-414b-9a9d-9a8474db679e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:05.186961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92bec0-b6e8-45e2-80e0-1a614816b8d6 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:05.198108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 317/627] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:05 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/edc00ecebf0c451b94b56e3e97254010/roles/fae6b286f5584beb868e5087cbf3d351 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:05.199647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1490c76-44f6-4e20-908f-38830e3ba873 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.200295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1490c76-44f6-4e20-908f-38830e3ba873 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.200776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1490c76-44f6-4e20-908f-38830e3ba873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.220465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f1490c76-44f6-4e20-908f-38830e3ba873 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:05.222566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f1490c76-44f6-4e20-908f-38830e3ba873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:05.255033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a4f89-c68f-43c4-a27e-7b02dad58683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.256344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a4f89-c68f-43c4-a27e-7b02dad58683 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.256828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a4f89-c68f-43c4-a27e-7b02dad58683 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.257332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a4f89-c68f-43c4-a27e-7b02dad58683 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.267046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a4f89-c68f-43c4-a27e-7b02dad58683 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:05.269256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a4f89-c68f-43c4-a27e-7b02dad58683 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d99a4f89-c68f-43c4-a27e-7b02dad58683 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:05.286596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:05.287688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:05.288719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:05.291606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 311/628] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:34:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:05.293793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaebd9-fae1-411f-8096-1be32bede791 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.294317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaebd9-fae1-411f-8096-1be32bede791 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.294791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaebd9-fae1-411f-8096-1be32bede791 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.296766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 312/629] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:05.300763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaebd9-fae1-411f-8096-1be32bede791 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.327386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 318/630] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:05.330076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bde91-4824-4514-abd4-11bed79c389c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.330674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bde91-4824-4514-abd4-11bed79c389c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.331219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bde91-4824-4514-abd4-11bed79c389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.359672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7c0bde91-4824-4514-abd4-11bed79c389c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:05.361259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7c0bde91-4824-4514-abd4-11bed79c389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:05.390925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:05.442832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaebd9-fae1-411f-8096-1be32bede791 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:05.451735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 319/631] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:05.454284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bde91-4824-4514-abd4-11bed79c389c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.498391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.499234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.499535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.499821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.500786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:05.501022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:05.502565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:05.526549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 313/632] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:34:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:05.534063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.549574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:05.596023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bde91-4824-4514-abd4-11bed79c389c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:05.644307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.645786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.646512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.647412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.661057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba309eb-e569-4479-9a5b-e913a530d112 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:05.661206 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:05.669827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:05.670773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:05.672012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:05.675449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 320/633] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:05.676357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.702888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:05.708202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.709129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.709679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.710063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.727230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:05.731690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:05.732710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:05.733567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:05.738054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 314/634] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:05.738956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.807053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c319a08-d217-4af4-a7a4-3f5241660807 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:05.809216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:05.849322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.850088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.850446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.850798 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.852354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e77c-e5a5-4e5a-a9a9-d1a6cd11cc30 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:05.889622 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:05.890414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:05.890819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:05.891600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:05.892352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:05.892687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:05.894183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:05.904015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 315/635] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:05.905006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:05.938250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:05.940051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:05.963249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.010273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a532f-aa89-49d4-8a30-52a774f61bef None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.038560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.047496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a8d6a-53b8-4cc7-9581-8b71d5fe6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.052493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 321/636] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:34:06.052635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8d6a-53b8-4cc7-9581-8b71d5fe6b88 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.052635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8d6a-53b8-4cc7-9581-8b71d5fe6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.052635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8d6a-53b8-4cc7-9581-8b71d5fe6b88 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.052890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.052990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a8d6a-53b8-4cc7-9581-8b71d5fe6b88 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:06.052990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a8d6a-53b8-4cc7-9581-8b71d5fe6b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.052990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a8d6a-53b8-4cc7-9581-8b71d5fe6b88 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.063883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 316/637] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:06.063883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19394593-83a4-45e4-bf6d-afe0ce4c9765 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.063883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19394593-83a4-45e4-bf6d-afe0ce4c9765 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.063883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19394593-83a4-45e4-bf6d-afe0ce4c9765 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.063883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 317/638] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:06.063883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19394593-83a4-45e4-bf6d-afe0ce4c9765 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.168588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19394593-83a4-45e4-bf6d-afe0ce4c9765 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.175021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65793a-7f95-4d13-956f-5a46abfdf62d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.197915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.203502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.204403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.204789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.205164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.211680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cc6a5-c848-4762-8e3b-bc7094c47529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.212487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc6a5-c848-4762-8e3b-bc7094c47529 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.213195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc6a5-c848-4762-8e3b-bc7094c47529 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.213523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc6a5-c848-4762-8e3b-bc7094c47529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.216984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.218550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.224868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cc6a5-c848-4762-8e3b-bc7094c47529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.226292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cc6a5-c848-4762-8e3b-bc7094c47529 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:06.236166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:06.237329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:06.238612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:06.238612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:06.238612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:06.238612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:06.244080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 318/639] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:06.244080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-ea8cc6a5-c848-4762-8e3b-bc7094c47529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:06.244320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:06.245338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:06.246453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:06.246453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:06.246453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:06.246453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:06.249438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 322/640] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:06.250554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be71b-cb9a-4387-b815-38ec759b8b61 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.250846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be71b-cb9a-4387-b815-38ec759b8b61 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.251124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be71b-cb9a-4387-b815-38ec759b8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.268024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-642be71b-cb9a-4387-b815-38ec759b8b61 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:06.269193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-642be71b-cb9a-4387-b815-38ec759b8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:06.293081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.347137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 323/641] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:06.348012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642be71b-cb9a-4387-b815-38ec759b8b61 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.364163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b0a5-761e-4b9f-9cc1-3ad8e6ee4401 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.404259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.405053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.405336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.405616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.416436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.418610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:06.436654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:06.437642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:06.438563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:06.438563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:06.438563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:06.438563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:06.442500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 319/642] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:06.443363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.461672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642be71b-cb9a-4387-b815-38ec759b8b61 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.466631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.502011 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.502683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.502963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.503268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.503990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:06.504298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.505674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.521488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 324/643] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:06.521488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.552131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.560978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a28757-11fd-4648-8b9a-36e005c56424 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.598650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.599498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.599792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.600078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.600806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:06.601120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.602488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.619084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 320/644] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:06.619084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.624644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23853d-8c95-4c57-be57-517083bb767c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.660876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.661776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.662057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.662329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.673455 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:06.681637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:06.682580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:06.683550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 325/645] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:06.684991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.709885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.729429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069f857-a7bb-40a6-ada1-628ccd0403df None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.763753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.764716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.765000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.765278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.765992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:06.766550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.767926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.779469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 321/646] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:06.780247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.796137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216d739-b079-4f0d-a160-33eac820a6e2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.796723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.832294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.833099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.833394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.833677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.841087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.842593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:06.857122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:06.858034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:06.858943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:06.863063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 326/647] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:06.863662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.889483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605f73-2ae7-465b-9840-6685e5b8892f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:06.924242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:06.925045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:06.925336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:06.925614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:06.933999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:06.935462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:06.949502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:06.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:06.951478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 322/648] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:06.952089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:06.958789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:06.976055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c630bc9-9df8-4f7a-bf33-5b0b09fdd902 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.015182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.015807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.016349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.016634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.017388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:07.017703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.019081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.027446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 327/649] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:07.028516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.032403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.054909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973b472-e821-41f7-bde9-c1c07cd7d0c9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.090190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.090988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.091298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.091578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.099039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.100499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:07.114753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:07.115741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:07.116682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 323/650] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:07.117275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.143360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4b02-8bac-4985-abd1-6a9b01a6ccbd None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.181023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.181690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.182084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.182258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.183041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:07.183415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.184855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.202559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 328/651] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:07.202559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.209639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.239648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f04a3-1d4b-4db1-99f6-3d4a52ee1688 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.277149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.277839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.278198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.278551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.279490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:07.280192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.281306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.283084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.300866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 324/652] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:07.301769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.312821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30afeb1-3951-4f91-9e8e-3905e209ce54 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.349487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.350371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.350714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.351054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.360921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.362379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:07.379765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:07.380737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:07.381633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:07.381633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:07.381633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:07.381633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:07.381633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 329/653] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:07.382157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.406040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1f963-7995-4f31-b43b-c4ce62709334 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.438377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.439411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.440006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.440364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.440690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.441495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:07.441803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.443241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.460166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 325/654] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:07.460967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.485541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b496-890e-4841-9622-88d0bbf32307 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.517340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.520674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ab905-f69f-4295-81b0-52d106decd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.521332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ab905-f69f-4295-81b0-52d106decd08 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.521616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ab905-f69f-4295-81b0-52d106decd08 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.521905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ab905-f69f-4295-81b0-52d106decd08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.522728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ab905-f69f-4295-81b0-52d106decd08 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=c37e7d70e2864edaa125e8f5ac1a3373) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:07.523036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ab905-f69f-4295-81b0-52d106decd08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.524500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ab905-f69f-4295-81b0-52d106decd08 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.530254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 330/655] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/role_assignments?user.id=c37e7d70e2864edaa125e8f5ac1a3373&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:07.531673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249537b-6b2a-4008-9723-e1d08ee7640a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.531673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249537b-6b2a-4008-9723-e1d08ee7640a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.531973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249537b-6b2a-4008-9723-e1d08ee7640a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.535288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 331/656] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:07.535288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249537b-6b2a-4008-9723-e1d08ee7640a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.589634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6ad5a-c725-4a36-84e7-bc414185ecc0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.627240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2ad97-6ed1-4ef2-b96c-6910941d11cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.627908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ad97-6ed1-4ef2-b96c-6910941d11cb None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.628193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ad97-6ed1-4ef2-b96c-6910941d11cb None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.628472 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ad97-6ed1-4ef2-b96c-6910941d11cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.659852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249537b-6b2a-4008-9723-e1d08ee7640a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.689039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.705100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2ad97-6ed1-4ef2-b96c-6910941d11cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.706966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2ad97-6ed1-4ef2-b96c-6910941d11cb None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.707406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.708074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.708359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.708635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.709359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:07.709664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.711018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.723395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 332/657] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:07.724200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.762943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.817432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 326/658] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:34:07.818957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf1546-48d7-4bd6-848f-e10c991bfbbc None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.819269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf1546-48d7-4bd6-848f-e10c991bfbbc None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.819553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf1546-48d7-4bd6-848f-e10c991bfbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.836822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6dbf1546-48d7-4bd6-848f-e10c991bfbbc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:07.837999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6dbf1546-48d7-4bd6-848f-e10c991bfbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:07.842861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2a72f-bae2-4de6-99a7-ea242f33adb3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:07.876045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:07.876687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:07.876973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:07.877253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:07.911252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 327/659] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:07.911252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf1546-48d7-4bd6-848f-e10c991bfbbc None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:07.942862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:07.963567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:07.965057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:07.994091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.016408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf1546-48d7-4bd6-848f-e10c991bfbbc None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.054117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.054912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.055199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.055521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.062683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.064158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.072779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 333/660] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:34:08.073924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:08.078726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:08.079789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 328/661] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:08.080924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.169476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.179773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd7029-398e-4983-9b09-dedb2d925908 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.188390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935da7-8d09-42df-9afe-afac6b3d81a0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.216602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.217396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.217681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.217965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.223150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.223957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.224237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.224506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.226003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.228910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:08.235927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.237389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:08.237578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:08.238486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:08.239376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 329/662] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:08.240705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:08.261604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:08.262541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:08.264461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:08.264461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:08.264461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:08.264461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:08.264461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 334/663] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:08.264461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.351250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2526bd8-405e-4fa3-8a9b-3e73815874b0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.374265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ba6f9-e6c2-45c7-bd0d-df7f005ec2e6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.387906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.388700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.388989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.389277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.400252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.401699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.414167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.415033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.415547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.416013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.417009 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:08.417522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.419098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:08.419247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:08.420232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:08.421132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:08.421132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:08.421132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:08.421132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:08.421132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 330/664] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:08.421132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.423117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.446238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 335/665] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:08.446238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.491263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.542371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dac3c5-7cd3-47a0-b154-9e1c22a3eeba None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.552176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1dfa9-7832-4e45-a214-c700e2ac1290 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.577587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.578249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.578534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.578811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.579572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:08.579978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.581324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.587058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.587742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.588026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.588308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.589022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:08.589358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.594526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 331/666] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:08.594686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.594781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.606317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 336/667] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:08.611091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.668397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.696813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06259a46-c636-4a87-8cf8-75155f8aba17 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.712876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.722727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029df2-5e53-4233-85f7-620dc0474d12 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.734284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.734952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.735264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.735550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.736273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:08.736585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.737966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.751264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 332/668] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:08.752490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.761078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.762333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.762936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.763065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.831317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.832768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.859361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e65d1-bd41-42f3-8f41-04cb7071ef21 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:08.891342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:08.901075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:08.901731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:08.902032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:08.902319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:08.913182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:08.914698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:08.932603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:08.934056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:08.934987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:08.934987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:08.934987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:08.934987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:08.934987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 333/669] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:08.935729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.953002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 337/670] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:34:08.954029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:08.970963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.047418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508828-43da-421b-a209-f76fbe407e27 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.056577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0775f-6afd-4d8f-b537-6a73be06dd8e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.084537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.085435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.085725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.086002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.090993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.091824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.092115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.092397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.093031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.094479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.099119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.100633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:09.107947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:09.108815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 334/671] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:09.110347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:09.116504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:09.117483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:09.118362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:09.122957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 338/672] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:09.123967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.139691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.221516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.238152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d73a50-e443-43bb-8ed7-5190e24108a5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.239861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b83eb3-f20f-44d7-beea-6e4dad624f31 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.277961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.278873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.279162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.279641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.284935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.285671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.286046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.286395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.287330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:09.288061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.289442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.291612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.293623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.302825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 335/673] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:09.304200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:09.313012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:09.314108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:09.315195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:09.315195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:09.315195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:09.315195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:09.318542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 339/674] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:09.319584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.383830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.419553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a2e0b-a175-4afd-b9ee-f7f52e53dc99 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.423530 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949ae85-6a2f-4109-9250-ef6a32a82e21 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.457010 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.457988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.458252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.458723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.458912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.459187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.459500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.459829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.460278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:09.460589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.461226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:09.461745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.462031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.463647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.476227 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 340/675] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:09.476689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 336/676] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:09.477540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.477649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.496359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.592909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6e802-bafe-464e-b05e-53d24caddbbf None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.593526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09a2c-569b-427c-acf5-4e1613197bd2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.620464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.629450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.630109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.630395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.630676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.631422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:09.631731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.632190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.632979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.633078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.633262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.633539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.640664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.642419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.645443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 337/677] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:09.646207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:09.657894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:09.658915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:09.659929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 341/678] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:09.660544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.713933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.748429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969c014-762e-4d2a-ba2a-3aef62f29914 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.757892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfae5b-a74a-458b-bc88-b009577a60a3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.781969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a5c9-3647-4efe-83c4-48233373a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.782622 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a5c9-3647-4efe-83c4-48233373a83e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.782907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a5c9-3647-4efe-83c4-48233373a83e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.783194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a5c9-3647-4efe-83c4-48233373a83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.784049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a5c9-3647-4efe-83c4-48233373a83e None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=f98ec37cbc1f4da88cc2d7887b26aa41) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:09.784365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a5c9-3647-4efe-83c4-48233373a83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.785785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a5c9-3647-4efe-83c4-48233373a83e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.800372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 338/679] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/role_assignments?user.id=f98ec37cbc1f4da88cc2d7887b26aa41&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:09.800569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.800700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2691c8-4c1a-4916-b1f6-91c273d16554 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.800789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.800861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2691c8-4c1a-4916-b1f6-91c273d16554 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.800929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.800997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2691c8-4c1a-4916-b1f6-91c273d16554 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.801065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.801065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=e54dc244053a4253aa32f1eebd655589) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:09.801065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.801255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 339/680] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:09.801255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2691c8-4c1a-4916-b1f6-91c273d16554 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.801378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.815493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 342/681] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/role_assignments?user.id=e54dc244053a4253aa32f1eebd655589&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:09.815493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:09.868270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.930721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35d17-b81f-4bfa-8a36-5bcfabb98d24 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.931275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2691c8-4c1a-4916-b1f6-91c273d16554 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:09.967083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:09.975615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.975855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62605b-4353-4d02-9713-791caa571c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:09.976424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.976585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62605b-4353-4d02-9713-791caa571c83 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:09.976729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.976978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.977076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62605b-4353-4d02-9713-791caa571c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:09.977357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62605b-4353-4d02-9713-791caa571c83 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:09.978270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62605b-4353-4d02-9713-791caa571c83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:09.978649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62605b-4353-4d02-9713-791caa571c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.980735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62605b-4353-4d02-9713-791caa571c83 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:09.988235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:09.989018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:10.005218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:10.006276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:10.007165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:10.007675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 343/682] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:10.007749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 340/683] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:10.007816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13709d39-0253-4d06-ba34-9fc7a9047bf8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:10.007816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13709d39-0253-4d06-ba34-9fc7a9047bf8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:10.007945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13709d39-0253-4d06-ba34-9fc7a9047bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:10.017438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.028052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-13709d39-0253-4d06-ba34-9fc7a9047bf8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:10.029261 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-13709d39-0253-4d06-ba34-9fc7a9047bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:10.114625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 344/684] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:10.115608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13709d39-0253-4d06-ba34-9fc7a9047bf8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.163167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:10.175247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a90d6-0bb2-49ae-8349-a0d60f0e16ec None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:10.214713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:10.215476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:10.215885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:10.216237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:10.246625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13709d39-0253-4d06-ba34-9fc7a9047bf8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:10.294407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:10.295730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:10.295864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:10.296400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:10.296807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:10.298071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:10.298521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:10.300082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:10.307933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:10.309420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:10.318823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 345/685] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:10.324421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.428527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:10.434923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea2721-d7f7-43d6-93c1-4855ea88ee2c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:10.439366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 341/686] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:34:10.440218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.479579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:10.481745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:10.482492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:10.482950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:10.496771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:10.506612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:10.507801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:10.508834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:10.509895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 346/687] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:10.510466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.555563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:10.568058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46e73-f055-440c-a406-0684e51fc1ce None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:10.615069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:10.615761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:10.616046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:10.616325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:10.617215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=45c718c1e1024d73b6b635f77bacdbed) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:10.617923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:10.619800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:10.635239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 342/688] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/role_assignments?user.id=45c718c1e1024d73b6b635f77bacdbed&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:10.635239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.650151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf4e74-cf9e-440b-a2c0-f053d90de7ba None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:10.697076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:10.697888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:10.698174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:10.698452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:10.732121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:10.733530 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:10.771500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:10.772898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:10.774188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:10.774188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:10.774188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:10.774188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:10.774188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 347/689] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:10.784223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.803807 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10555f-926e-40f9-970c-1164d276ea16 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:10.817865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:10.844323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:10.844994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:10.845277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:10.845560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:10.846297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:10.846603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:10.847998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:10.859045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 343/690] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:10.864093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:10.885466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:10.953329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791df5f-d7d6-46d1-8811-e39a2a220e3c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:10.981949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52962e-047d-49af-999c-d8b8cc0a3bae None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.001457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.002060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.002347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.002625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.003403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:11.003711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.005092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.026151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 348/691] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:11.028256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.035193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.036041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.036324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.036603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.048971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.050421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:11.070280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:11.071300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:11.072726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:11.072726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:11.072726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:11.072726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:11.072726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 344/692] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:11.077136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.142436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:11.191232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2d5d-9d20-452d-af25-5d8b15bb7c52 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.207578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:11.245127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.246346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.248195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.248685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.264065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.266852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.271747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252925-6063-41b5-9f04-42c1248f04c3 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:11.293225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:11.294139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:11.295031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:11.302439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 349/693] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:11.303897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.360444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.361159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.361441 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.361721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.362491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:11.362805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.364187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.393727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 345/694] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:11.396621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.480382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cca7c-bca9-4e06-8152-a8bcb89b603e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.507606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:11.530517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71282cc3-213d-44c2-b11b-7afbb4ca9f05 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.535895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.536576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.536871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.537159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.537962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:11.538280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.539768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.559353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:11.562170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 350/695] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:11.569031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.569881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.570167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.570488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.572195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.578477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.580040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:11.595242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:11.597628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:11.599873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 346/696] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:11.603939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.772895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daa658-8c12-4bfb-b49f-a9531e58fc99 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.796275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd404-7638-4ebe-83b3-dc7c187ca82f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:11.848868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.850964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.852636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.853095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.854103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=edc00ecebf0c451b94b56e3e97254010) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:11.855655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.863243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.867415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 351/697] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/role_assignments?user.id=edc00ecebf0c451b94b56e3e97254010&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:11.874349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb98fd5-6047-4853-990f-75fb8aada013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:11.875436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98fd5-6047-4853-990f-75fb8aada013 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:11.875987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98fd5-6047-4853-990f-75fb8aada013 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:11.876480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98fd5-6047-4853-990f-75fb8aada013 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:11.877599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb98fd5-6047-4853-990f-75fb8aada013 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:11.878173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb98fd5-6047-4853-990f-75fb8aada013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:11.879930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb98fd5-6047-4853-990f-75fb8aada013 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:11.914074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 347/698] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:11.920154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:11.998598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.061174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a9e33-9dae-42d6-a555-a054c1644a31 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.096969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:12.097632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.097921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.098200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.157704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffe97f-e6f1-4054-8a03-16f00e4b7dce None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.158326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffe97f-e6f1-4054-8a03-16f00e4b7dce None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.158788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffe97f-e6f1-4054-8a03-16f00e4b7dce None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.160657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 348/699] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:12.166697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a051f-a9c0-4fb4-baf7-0d80a1c3f5c3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.166998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a051f-a9c0-4fb4-baf7-0d80a1c3f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.167313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a051f-a9c0-4fb4-baf7-0d80a1c3f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.178677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:12.180212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:12.190461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d01a051f-a9c0-4fb4-baf7-0d80a1c3f5c3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:12.191983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d01a051f-a9c0-4fb4-baf7-0d80a1c3f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:12.239998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.240652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.273461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 349/700] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:12.274860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf917f2-4a2e-43e7-ac39-987a798ffb00 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.275154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf917f2-4a2e-43e7-ac39-987a798ffb00 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.276434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf917f2-4a2e-43e7-ac39-987a798ffb00 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.277730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 350/701] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:12.282927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713430-9812-4da5-bbfc-b42fd786b756 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.283323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713430-9812-4da5-bbfc-b42fd786b756 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.283516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713430-9812-4da5-bbfc-b42fd786b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.300695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e3713430-9812-4da5-bbfc-b42fd786b756 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:12.301868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e3713430-9812-4da5-bbfc-b42fd786b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:12.319237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 352/702] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 13:34:12.320137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.382785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 351/703] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:34:12.383691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713430-9812-4da5-bbfc-b42fd786b756 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.425001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b34f4-c971-4d43-857d-e226171504b5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.460630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:12.464942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.465236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.465515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.476291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:12.477745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:12.489871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713430-9812-4da5-bbfc-b42fd786b756 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.498054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:12.502105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:12.504161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:12.505158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:12.505158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:12.505158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:12.505158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:12.505158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 353/704] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:12.505158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.514340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.526933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:12.527757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.528042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.528315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.538662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:12.540119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:12.557863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:12.561107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:12.563245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:12.563245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:12.563245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:12.563245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:12.563245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 352/705] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:12.563245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.620370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c579bb-9367-4e26-8592-a75bf6541994 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.660125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:12.661040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.661327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.661608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.662265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:12.663665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:12.663875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76717016-8716-4968-a2b7-12ea55d0f1bc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:12.678535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:12.680949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:12.684599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 354/706] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jun 23 13:34:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:12.686645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.699988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:12.700783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.701112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.701398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.702123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:12.702437 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:12.703889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:12.715928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 353/707] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:12.716756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.740711 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.756426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.795130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ec36-425c-4fc5-9f6f-461493e93ce3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.825107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cff31-fa64-4c1e-a2c9-db2da346a900 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.833105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:12.833991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.834503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.834937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.835927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:12.836379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:12.837897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:12.856387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 355/708] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:12.857622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.859762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:12.860507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:12.860793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:12.861074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:12.861767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:12.862157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:12.863583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:12.868569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 354/709] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 23 13:34:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:12.869432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:12.954133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:12.970993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81201-4f22-46b2-87b6-8074e30eb06d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:12.974059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b9681-7de7-4e69-b880-a6e30d54685f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:13.001314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:13.010957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:13.012267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.012778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.012892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:13.013404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.013574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.013863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.014149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.015029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:13.017144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:13.021784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:13.023256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:13.039130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:13.040097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:13.041457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:13.041967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 356/710] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:34:12 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:13.041967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:13.044603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 355/711] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:13.049985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:13.166332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7f3c-395c-4f87-98b7-eafef0fcc5d2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:13.188533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b0dd0-ba15-4ace-a64e-ba6c7f65a821 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:13.207290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7c493-6fbb-4fd0-9a15-d51f627f8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:13.208390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7c493-6fbb-4fd0-9a15-d51f627f8db3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.208878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7c493-6fbb-4fd0-9a15-d51f627f8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.209537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7c493-6fbb-4fd0-9a15-d51f627f8db3 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.210549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7c493-6fbb-4fd0-9a15-d51f627f8db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:13.211060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7c493-6fbb-4fd0-9a15-d51f627f8db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:13.212882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7c493-6fbb-4fd0-9a15-d51f627f8db3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:13.228146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 356/712] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:13.230078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48627cb2-a572-46bd-ae76-bfe866b502b3 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.231084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48627cb2-a572-46bd-ae76-bfe866b502b3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.231723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48627cb2-a572-46bd-ae76-bfe866b502b3 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.233443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 357/713] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:13.238594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48627cb2-a572-46bd-ae76-bfe866b502b3 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:13.241013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c75da-3be8-4382-93b9-7062d34c7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:13.241853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:13.242448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c75da-3be8-4382-93b9-7062d34c7d43 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.242740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c75da-3be8-4382-93b9-7062d34c7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.243185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c75da-3be8-4382-93b9-7062d34c7d43 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.243876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c75da-3be8-4382-93b9-7062d34c7d43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:13.244249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c75da-3be8-4382-93b9-7062d34c7d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:13.246221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c75da-3be8-4382-93b9-7062d34c7d43 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:13.255562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 357/714] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 23 13:34:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:13.255562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58383277-5c8b-4289-97f2-5103ca8e34b3 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.255562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58383277-5c8b-4289-97f2-5103ca8e34b3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.255562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58383277-5c8b-4289-97f2-5103ca8e34b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.281115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-58383277-5c8b-4289-97f2-5103ca8e34b3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:13.282387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-58383277-5c8b-4289-97f2-5103ca8e34b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:13.348040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:13.388431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 358/715] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:13.396611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48627cb2-a572-46bd-ae76-bfe866b502b3 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:13.411268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58383277-5c8b-4289-97f2-5103ca8e34b3 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:13.444505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:13.445165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.445447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.445723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.446551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=8aae95f970644f279053e3f140353481, user.id=c37e7d70e2864edaa125e8f5ac1a3373) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:13.446858 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:13.448321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:13.455291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 358/716] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:13 2022] GET /identity/v3/role_assignments?user.id=c37e7d70e2864edaa125e8f5ac1a3373&scope.project.id=8aae95f970644f279053e3f140353481&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:13.538973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58383277-5c8b-4289-97f2-5103ca8e34b3 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:13.577148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:13.578215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.578646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.579067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.579951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:13.581525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:13.594283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:13.595614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:13.596665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:13.599300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 359/717] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:13 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:13.605172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:13.691825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:13.733905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1229-c4b5-499f-b25a-7144cfd1737b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:13.808127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27350d70-f908-4c86-a096-57fb363b067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:13.809190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27350d70-f908-4c86-a096-57fb363b067d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:13.809478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27350d70-f908-4c86-a096-57fb363b067d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:13.809758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27350d70-f908-4c86-a096-57fb363b067d None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:13.810479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27350d70-f908-4c86-a096-57fb363b067d None admin] RBAC: Adding query filter params (name=network) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:13.810794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27350d70-f908-4c86-a096-57fb363b067d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:13.812473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27350d70-f908-4c86-a096-57fb363b067d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:13.817749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 359/718] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:13.822810 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:13.890637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:13.989983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba43f8-b00f-4edd-83f0-9f286c7531c6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:14.047723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166f930-946d-4f1d-94b5-c046e4478997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:14.048404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166f930-946d-4f1d-94b5-c046e4478997 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:14.048690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166f930-946d-4f1d-94b5-c046e4478997 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:14.048969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166f930-946d-4f1d-94b5-c046e4478997 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:14.049684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166f930-946d-4f1d-94b5-c046e4478997 None admin] RBAC: Adding query filter params (type=network) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:14.049993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166f930-946d-4f1d-94b5-c046e4478997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:14.051394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166f930-946d-4f1d-94b5-c046e4478997 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:14.059307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 360/719] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:14.567430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042426a-4c50-48b9-8933-0a41bfc2f2bf None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:14.567752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042426a-4c50-48b9-8933-0a41bfc2f2bf None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:14.567996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042426a-4c50-48b9-8933-0a41bfc2f2bf None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:14.569629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 360/720] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:14.574711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a99a-ce21-4fe8-a8fb-5d8e4b072da9 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:14.575007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a99a-ce21-4fe8-a8fb-5d8e4b072da9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:14.575318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a99a-ce21-4fe8-a8fb-5d8e4b072da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:14.591842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d810a99a-ce21-4fe8-a8fb-5d8e4b072da9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:14.593019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d810a99a-ce21-4fe8-a8fb-5d8e4b072da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:14.660669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 361/721] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:14.684988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042426a-4c50-48b9-8933-0a41bfc2f2bf None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:14.821068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042426a-4c50-48b9-8933-0a41bfc2f2bf None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:14.859496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:14.867857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:14.868662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:14.868948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:14.869226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:14.882745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:14.890892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:14.892322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:14.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 361/722] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:14.898284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810a99a-ce21-4fe8-a8fb-5d8e4b072da9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:14.936861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:15.015071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810a99a-ce21-4fe8-a8fb-5d8e4b072da9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:15.049364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:15.050030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:15.050364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:15.050645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:15.051421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:15.051729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:15.053096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:15.065224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 362/723] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:15.070524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:15.189999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9858b4-c3ad-40c4-a47c-5a8cb82c5cf2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:15.234688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:15.235507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:15.235794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:15.236071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:15.251510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:15.253017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:15.274638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:15.275614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:15.276583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:15.276583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:15.276583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:15.276583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:15.276583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 362/724] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:15.282214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:15.403043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:15.411504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e334a1-ee4d-436e-98a6-1e003237bcc1 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:15.446598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:15.447181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:15.447494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:15.447823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:15.448572 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:15.448887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:15.450262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:15.464094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 363/725] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:15.468352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:15.524858 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:15.585899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946c37-20a8-4b14-8c11-590869968dce None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:15.637762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375ddd-4ed2-4927-bf12-cba865e9654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:15.638561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375ddd-4ed2-4927-bf12-cba865e9654d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:15.638844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375ddd-4ed2-4927-bf12-cba865e9654d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:15.639121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375ddd-4ed2-4927-bf12-cba865e9654d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:15.652934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c375ddd-4ed2-4927-bf12-cba865e9654d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:15.654415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c375ddd-4ed2-4927-bf12-cba865e9654d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-2c375ddd-4ed2-4927-bf12-cba865e9654d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:15.672047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:15.673045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:15.674027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 363/726] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:15.678729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:15.804197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167219b2-1e90-4b6b-90bb-50f7271859b7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:15.849284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:15.850921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999d28-34df-4ec3-9467-8d9d5bed6a36 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:15.851481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999d28-34df-4ec3-9467-8d9d5bed6a36 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:15.851659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999d28-34df-4ec3-9467-8d9d5bed6a36 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:15.852893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 364/727] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:15.853493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:15.853771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:15.854046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:15.855516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:15.855832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:15.857270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:15.858551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8300e-82a1-4948-8655-08ee6656357c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:15.859150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8300e-82a1-4948-8655-08ee6656357c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:15.859678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8300e-82a1-4948-8655-08ee6656357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:15.876442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 364/728] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 23 13:34:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:15.881808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:15.904238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-26e8300e-82a1-4948-8655-08ee6656357c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:15.905775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-26e8300e-82a1-4948-8655-08ee6656357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:15.917205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.002133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fb455-c154-4b96-b78f-18d31480373e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.005272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 365/729] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:16.006687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7155abe-4ef5-4325-96e1-72f35ab07f18 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.006984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7155abe-4ef5-4325-96e1-72f35ab07f18 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.007304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7155abe-4ef5-4325-96e1-72f35ab07f18 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.013022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 366/730] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:16.014602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78040b2-3da6-422c-94ab-f9b82a0c7f1b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.014949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78040b2-3da6-422c-94ab-f9b82a0c7f1b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.015757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78040b2-3da6-422c-94ab-f9b82a0c7f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.046813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e78040b2-3da6-422c-94ab-f9b82a0c7f1b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:16.048048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e78040b2-3da6-422c-94ab-f9b82a0c7f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:16.049488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca7b2f-05ea-4628-a6a7-c936bd63f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.050150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca7b2f-05ea-4628-a6a7-c936bd63f362 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.050439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca7b2f-05ea-4628-a6a7-c936bd63f362 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.051237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca7b2f-05ea-4628-a6a7-c936bd63f362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.076984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.123056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 367/731] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 13:34:16.123056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78040b2-3da6-422c-94ab-f9b82a0c7f1b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.125462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca7b2f-05ea-4628-a6a7-c936bd63f362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:16.126678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca7b2f-05ea-4628-a6a7-c936bd63f362 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:16.144434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.227112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78040b2-3da6-422c-94ab-f9b82a0c7f1b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.232549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 365/732] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 13:34:16.238071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdd8b-c8aa-48cd-b177-da9b0b1eff1d None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.238366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdd8b-c8aa-48cd-b177-da9b0b1eff1d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.238645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdd8b-c8aa-48cd-b177-da9b0b1eff1d None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.239944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 366/733] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:16.244072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbdd8b-c8aa-48cd-b177-da9b0b1eff1d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.264966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.265921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.267051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.267550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.268709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:16.271056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:16.303236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 368/734] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:16 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:16.303236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.331264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.393603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbdd8b-c8aa-48cd-b177-da9b0b1eff1d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.412661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.439064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145e74e-ec81-4272-b498-288e7466bf9d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.440759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13089075-d72c-492d-89e1-c69fdaa03fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.441761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13089075-d72c-492d-89e1-c69fdaa03fa6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.442141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13089075-d72c-492d-89e1-c69fdaa03fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.442495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13089075-d72c-492d-89e1-c69fdaa03fa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.455351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13089075-d72c-492d-89e1-c69fdaa03fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-13089075-d72c-492d-89e1-c69fdaa03fa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:16.471185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:16.472309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:16.473418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 367/735] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:16.474116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64777a3a-3fcc-4fb2-8ce6-e6d3952b65e4 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.474183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64777a3a-3fcc-4fb2-8ce6-e6d3952b65e4 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.474773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64777a3a-3fcc-4fb2-8ce6-e6d3952b65e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.479113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.481293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.481583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.481912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.497160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-64777a3a-3fcc-4fb2-8ce6-e6d3952b65e4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:16.497363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:16.497446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-64777a3a-3fcc-4fb2-8ce6-e6d3952b65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:16.498100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:16.517834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:16.518783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:16.520135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:16.520135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:16.520135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:16.520135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:16.520135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 369/736] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:16.520135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.587368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 368/737] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:16.588559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64777a3a-3fcc-4fb2-8ce6-e6d3952b65e4 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.625417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.660260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa60a9-c0b0-4728-a94b-5959e1c2b655 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.697492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.698573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.699154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.699677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.700757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:16.701268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:16.703081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:16.712330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64777a3a-3fcc-4fb2-8ce6-e6d3952b65e4 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.717245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 370/738] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:16.718429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.719945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.756407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.758452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.759142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.759762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.760744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:16.761281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:16.762998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:16.776247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 369/739] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:16.777507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.841288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e969-abac-4d65-8631-513f2f8cb761 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.875576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.876387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.876668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.876950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.879985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:16.890669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:16.902834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:16.903970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:16.904832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:16.905497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223983-47ce-4813-88a0-6725e4613c0a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:16.905574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 371/740] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:16.905574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:16.943832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3625d04-61d7-4167-89c5-d7fc25245292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:16.944623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625d04-61d7-4167-89c5-d7fc25245292 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.944905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625d04-61d7-4167-89c5-d7fc25245292 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.945176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625d04-61d7-4167-89c5-d7fc25245292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.957640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3625d04-61d7-4167-89c5-d7fc25245292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:16.959191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3625d04-61d7-4167-89c5-d7fc25245292 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-b3625d04-61d7-4167-89c5-d7fc25245292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:16.977661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:16.978593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:16.980460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:16.980460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:16.980460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:16.980460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:16.983931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 370/741] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:16.985026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdbce1-2b45-44c9-83e5-07d0c8453540 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:16.985315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdbce1-2b45-44c9-83e5-07d0c8453540 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:16.985592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdbce1-2b45-44c9-83e5-07d0c8453540 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:16.986989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 371/742] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:16.987558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdbce1-2b45-44c9-83e5-07d0c8453540 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.003963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.014600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe69ec-488b-4fc8-8236-e7363bedf677 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.049568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.050376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.050667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.050956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.058334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.059817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:17.074149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:17.075243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:17.076347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:17.079953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 372/743] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:17.080752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.099942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdbce1-2b45-44c9-83e5-07d0c8453540 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.136709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4862a4-0a15-499f-aa18-564918c3703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.137382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4862a4-0a15-499f-aa18-564918c3703e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.137673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4862a4-0a15-499f-aa18-564918c3703e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.137954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4862a4-0a15-499f-aa18-564918c3703e None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.138707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4862a4-0a15-499f-aa18-564918c3703e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:17.139019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4862a4-0a15-499f-aa18-564918c3703e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.140433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4862a4-0a15-499f-aa18-564918c3703e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.140563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.150364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 372/744] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:17.151588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03fed-24a0-41b6-8c16-41559bd7f432 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.152402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03fed-24a0-41b6-8c16-41559bd7f432 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.152696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03fed-24a0-41b6-8c16-41559bd7f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.168313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e0b03fed-24a0-41b6-8c16-41559bd7f432 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:17.169501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e0b03fed-24a0-41b6-8c16-41559bd7f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:17.193700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c451778-c70d-491b-be25-d8245633c6bb None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.234497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.235295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.235701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.236061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.236807 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:17.237125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.247277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 373/745] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 13:34:17.247277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03fed-24a0-41b6-8c16-41559bd7f432 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.247523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.247614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.262943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 373/746] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:17.263688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.345912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03fed-24a0-41b6-8c16-41559bd7f432 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.372558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142de4-cf95-45fa-a688-be85f477590d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.380985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.381658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.381946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.382228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.383019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:17.383364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.384801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.389653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.403340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 374/747] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:17.403340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.414118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.414912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.415213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.415507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.427496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.428963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:17.446581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:17.447717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:17.449145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:17.449145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:17.449145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:17.449145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:17.449145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 374/748] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:17.449145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.475156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.515701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139cbf3-0cf9-478f-9d67-ac3b4c42057d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.550942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.551637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.551927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.552208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.552933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.554315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.565978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370e10e-a3f1-4ecd-9e2c-d675993b34bc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.579241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 375/749] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:17 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:17.579241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.632111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.633163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.633455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.633736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.645799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.648072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:17.672334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:17.673341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:17.674278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:17.677070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 375/750] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:17.678025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.705492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddfb4-7b5b-44c3-b6a1-d7d88274c7ca None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.717121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.736203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:17.749133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.749804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.750096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.750381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.751247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=8aae95f970644f279053e3f140353481, user.id=edc00ecebf0c451b94b56e3e97254010) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:17.751565 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.753066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.760666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 376/751] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/role_assignments?user.id=edc00ecebf0c451b94b56e3e97254010&scope.project.id=8aae95f970644f279053e3f140353481&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:17.761868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.816648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b0e11-cf51-4bb4-8eef-1d9a8bd1382b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.868095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.869065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.869912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.870210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.871870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:17.872194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.874678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.880709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f633c94-4ee1-4df1-8cd3-c4ab1f6ab8a2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:17.896064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 376/752] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:17.898641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:17.923161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:17.924057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:17.924452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:17.924832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:17.925780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:17.926197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:17.927848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:17.947920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 377/753] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:17.954019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.009331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:18.027899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:18.044710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e95593-ca3a-4476-abeb-d7c83d65329c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.101168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719e68-03d3-4409-8b59-544175ad21ab None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.118141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:18.118949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.119259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.119546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.130458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:18.131942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:18.153608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:18.154589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:18.155572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 377/754] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:18.161796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.166625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:18.167610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.168093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.168564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.272642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:18.274451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:18.324467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:18.359433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1643-b879-44d1-9c65-c173aa4b3471 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.417980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 378/755] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:34:18.423261 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.427745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd6257-0985-418f-88e4-ade2986b9b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:18.427900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd6257-0985-418f-88e4-ade2986b9b4d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.428154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd6257-0985-418f-88e4-ade2986b9b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.428434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd6257-0985-418f-88e4-ade2986b9b4d None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.429275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd6257-0985-418f-88e4-ade2986b9b4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:18.429584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd6257-0985-418f-88e4-ade2986b9b4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:18.431019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd6257-0985-418f-88e4-ade2986b9b4d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:18.458378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 378/756] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:34:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:18.463176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b253e-b050-4d45-97f6-97181280bc76 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.463497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b253e-b050-4d45-97f6-97181280bc76 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.463781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b253e-b050-4d45-97f6-97181280bc76 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.465243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 379/757] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:18.468118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b253e-b050-4d45-97f6-97181280bc76 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.473321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:18.533625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9875-fc64-4c39-b909-1596a8b0e106 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.569146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589a744-a4db-461d-bd0e-228ac04898f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:18.569941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a744-a4db-461d-bd0e-228ac04898f7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.570227 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a744-a4db-461d-bd0e-228ac04898f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.570529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a744-a4db-461d-bd0e-228ac04898f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.582136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589a744-a4db-461d-bd0e-228ac04898f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:18.583618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589a744-a4db-461d-bd0e-228ac04898f7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:18.593081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:18.601817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b253e-b050-4d45-97f6-97181280bc76 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-3589a744-a4db-461d-bd0e-228ac04898f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:18.602516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:18.603441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:18.604345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:18.604345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:18.604345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:18.604345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:18.607346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 379/758] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:18.608612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a940c-d9a2-4b66-a8cd-f3ef0f89b57d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.608902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a940c-d9a2-4b66-a8cd-f3ef0f89b57d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.609180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a940c-d9a2-4b66-a8cd-f3ef0f89b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.625971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e77a940c-d9a2-4b66-a8cd-f3ef0f89b57d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:18.627148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e77a940c-d9a2-4b66-a8cd-f3ef0f89b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:18.650624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:18.652975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.653736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.654232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.668675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:18.670895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:18.695668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:18.696597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:18.697506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:18.697506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:18.697506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:18.697506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:18.700507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 380/759] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:18.700507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a940c-d9a2-4b66-a8cd-f3ef0f89b57d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.704128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 380/760] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:18.707228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.770017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:18.817805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd397f-774c-4b8b-8908-7ae605a5ad7a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.824141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a940c-d9a2-4b66-a8cd-f3ef0f89b57d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.853284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:18.853948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.854233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.854564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.855354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:18.855664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:18.856914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:18.857108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:18.864621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:18.865541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:18.866165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:18.866654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:18.867615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:18.867925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:18.869356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:18.873751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 381/761] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:18.874773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.882280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 381/762] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:18.889315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:18.988447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d28780-a208-44c5-8733-059899a436e9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:18.997334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246005b-a26f-4d8d-a5fe-9d49f1522b4d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.004747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:19.028618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.029645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.031324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.031756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.032574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.034092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.036483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.037389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.037780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.038161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.045379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.046984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:19.050082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:19.051241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:19.052318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:19.054849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 382/763] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jun 23 13:34:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:19.055791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:19.065278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:19.066339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:19.067246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:19.071714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 382/764] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:19.072699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.175592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:19.177365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457431-f5d3-4789-8ab9-9c5c873d4a7f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.200224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433a17d-fae5-4d4f-9ff8-0ccddc63abfb None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.221322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.222400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.222685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.222962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.231687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.233668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.239456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.240076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.240368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.240924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.241643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:19.241958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.243506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:19.250187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:19.251068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:19.252077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 383/766] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:19.252565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.256970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 383/766] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:19.256970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.304149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:19.365829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506010-c9e7-4b14-b93e-687a1dd491ff None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.378618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85426-97a0-4b63-b012-4e88cde37e39 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.394658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:19.402087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.403023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.403557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.403936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.404826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:19.405235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.406770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.418244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.418913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.419218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.419526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.419706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 384/767] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:19.420246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:19.420488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.420650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.421929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.438040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 384/768] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:19.438875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.555651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ff77-c1c3-42d2-8211-a5ec92a8bc3c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.556815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:19.562821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef9498-5b4f-4d6f-b510-0f13e889ed73 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.600306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.600975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.601263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.601545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.602145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.602383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:19.602702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.603014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.603395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.603746 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.604174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.604666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:19.605072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.606564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.615415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 385/769] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/role_assignments?user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:19.618128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.624782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 385/770] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:19.630488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.701464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:19.820040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65d720-1d59-4042-a12f-39f00fb04fda None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.822616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce1a2-9725-416e-8aa6-4cec26fb5911 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:19.865372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a111-cd6d-4301-bcf5-da1bdde44cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.865579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:19.866039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.866266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a111-cd6d-4301-bcf5-da1bdde44cf8 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.866368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.866556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a111-cd6d-4301-bcf5-da1bdde44cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.866663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.866835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a111-cd6d-4301-bcf5-da1bdde44cf8 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/c37e7d70e2864edaa125e8f5ac1a3373/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.867409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] RBAC: Adding query filter params (interface=public, service_id=76d3c9a54ef24bf29e25b2f384658475, region_id=RegionOne) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:19.867728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.868842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a111-cd6d-4301-bcf5-da1bdde44cf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=c37e7d70e2864edaa125e8f5ac1a3373, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:19.869107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.870341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a111-cd6d-4301-bcf5-da1bdde44cf8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:19.878505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 386/771] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/endpoints?service_id=76d3c9a54ef24bf29e25b2f384658475&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:19.884418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:19.891786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 386/772] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:19 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/c37e7d70e2864edaa125e8f5ac1a3373/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:34:19.945100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e808-9942-425c-8cd0-3b12e56533c3 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.945433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e808-9942-425c-8cd0-3b12e56533c3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.945674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e808-9942-425c-8cd0-3b12e56533c3 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.947265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 387/773] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:19.953003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc9779-3586-4a30-8d3d-b41fa0d594c5 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:19.953360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc9779-3586-4a30-8d3d-b41fa0d594c5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:19.953650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc9779-3586-4a30-8d3d-b41fa0d594c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:19.991332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8ccc9779-3586-4a30-8d3d-b41fa0d594c5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:19.992640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8ccc9779-3586-4a30-8d3d-b41fa0d594c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:20.012131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb6b4-9fcc-4439-a6a9-90de9959d7b7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:20.025320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:20.030613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:20.056780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:20.057479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.057777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.058099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.058809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:20.060544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:20.066982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 387/774] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:19 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:20.138901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 388/775] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:20.164221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:20.223991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac413b1b-0a57-41c0-8bc5-a6c162f63751 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.224438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac413b1b-0a57-41c0-8bc5-a6c162f63751 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.224843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac413b1b-0a57-41c0-8bc5-a6c162f63751 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.226589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 389/776] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:20.232509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd4749-d9d9-4fb9-a9b2-d7680e790ce9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.232915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd4749-d9d9-4fb9-a9b2-d7680e790ce9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.233293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd4749-d9d9-4fb9-a9b2-d7680e790ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.256674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2fbd4749-d9d9-4fb9-a9b2-d7680e790ce9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:20.257862 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2fbd4749-d9d9-4fb9-a9b2-d7680e790ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:20.283759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bf709-2a28-4f44-bc57-2684110dffc5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:20.320822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:20.321629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.321921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.322203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] PATH_INFO: `/v3/services/network` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.322860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:20.324332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:20.337070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:20.338132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:20.338975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:20.340300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 390/777] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:20.340374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 388/778] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:20 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:20.344538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd4749-d9d9-4fb9-a9b2-d7680e790ce9 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:20.376836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:20.441094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:20.490292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:20.540864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af053b-0ad1-497d-a69f-9e9270e4a41c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:20.560548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd4749-d9d9-4fb9-a9b2-d7680e790ce9 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:20.584460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:20.585281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.585571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.585850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.610943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:20.623564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:20.624479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:20.625397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 389/779] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:20.630645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:20.643319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:20.644003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.644482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.644774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.645491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] RBAC: Adding query filter params (name=network) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:20.645802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:20.648609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:20.658213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 391/780] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:20.663389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:20.788445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf933f4-8cf0-485e-bc30-0a2cd138870a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:20.833749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:20.846723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:20.847438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.847729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.848017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.848734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] RBAC: Adding query filter params (type=network) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:20.849050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:20.849325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6510-9ce4-4d8f-83b7-e59641810049 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:20.850437 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:20.858141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 392/781] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:20.863819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:20.885736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:20.912502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:20.913573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:20.914053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:20.914525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:20.915499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:20.916711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:20.918987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:20.932095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 390/782] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:20.938212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:21.050140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21706b9-da82-4144-b2cf-7304a4b07227 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:21.110459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b18a1-4c85-4109-881c-6112616ecfc2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:21.115804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:21.116478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:21.116766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:21.117047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:21.117847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] RBAC: Adding query filter params (interface=public, service_id=07afc8d501314673bdaef00372f1f3c7, region_id=RegionOne) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:21.118167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:21.119578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:21.128256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 393/783] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:34:20 2022] GET /identity/v3/endpoints?service_id=07afc8d501314673bdaef00372f1f3c7&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:21.135127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:21.169725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:21.171189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:21.171700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:21.171980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:21.194764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:21.196267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:21.229601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:21.231042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:21.231974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:21.231974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:21.231974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:21.231974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:21.235464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 391/784] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:21.239330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:21.247443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:21.260180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:21.292096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3421e3-040f-4b69-80ed-900b1da1b18c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:21.376386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be41fa-fc9e-45f5-b746-bab3dfa765b0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:21.396847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:21.397589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:21.397885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:21.398164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:21.398853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:21.400255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:21.411731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:21.412460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:21.412757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:21.413039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:21.413144 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 394/785] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:21 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:21.413868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:21.414181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:21.420395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:21.436250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 392/786] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:21.444663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:21.638723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501a72f-3bf9-4f4f-a8dd-6fabbfcdf2b7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:21.673617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:21.674419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:21.674708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:21.674989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:21.676997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:21.683904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:21.685566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:21.699844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:21.700814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:21.701763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:21.705077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 395/787] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:21.707088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:21.779448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:21.819806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004ce9-b791-4e10-9947-abe704187bd6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:21.865242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:21.865929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:21.866221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:21.866504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:21.867371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:21.867685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:21.869303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:21.895000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 393/788] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 23 13:34:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:21.900529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.013722 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b13-a4a6-4979-a239-ab7f12175ea9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:22.048971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:22.049778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.050066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.050349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.062235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:22.063799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:22.082019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:22.082970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:22.084005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:22.084005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:22.084005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:22.084005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:22.086801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 396/789] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:22.089983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.223474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e90e92-3696-43f5-b833-52328fe7d7b3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:22.249720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:22.266809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8658dcd-87e6-4455-92c5-617a98a70368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:22.267514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8658dcd-87e6-4455-92c5-617a98a70368 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.267803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8658dcd-87e6-4455-92c5-617a98a70368 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.268083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8658dcd-87e6-4455-92c5-617a98a70368 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.268878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8658dcd-87e6-4455-92c5-617a98a70368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:22.269194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8658dcd-87e6-4455-92c5-617a98a70368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:22.270579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8658dcd-87e6-4455-92c5-617a98a70368 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:22.285754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 394/790] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:22.291496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.330980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888440-6836-4eac-9094-19558e1c8502 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.331306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888440-6836-4eac-9094-19558e1c8502 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.331563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888440-6836-4eac-9094-19558e1c8502 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.333213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 395/791] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:22.337836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea89b84-4826-4d6b-8fe8-9df7a6f3f680 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.338127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea89b84-4826-4d6b-8fe8-9df7a6f3f680 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.338409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea89b84-4826-4d6b-8fe8-9df7a6f3f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.364613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8ea89b84-4826-4d6b-8fe8-9df7a6f3f680 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:22.365821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8ea89b84-4826-4d6b-8fe8-9df7a6f3f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:22.371563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:22.457594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eb7e-a597-462d-9e7a-34926fc21157 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:22.498473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:22.499316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.499768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.500199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.508279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:22.509750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:22.513600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 396/792] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:22.526042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:22.526968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:22.527898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:22.531326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 397/793] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:22.533373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea89b84-4826-4d6b-8fe8-9df7a6f3f680 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.552683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.661489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea89b84-4826-4d6b-8fe8-9df7a6f3f680 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:22.678009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978aab1-c5eb-4b54-a0fa-b13d5a6a262b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:22.679299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:22.687053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:22.701146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412ab50-245a-4366-872c-42cbc8a4c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:22.701814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ab50-245a-4366-872c-42cbc8a4c903 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.702106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ab50-245a-4366-872c-42cbc8a4c903 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.702390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ab50-245a-4366-872c-42cbc8a4c903 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.703354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412ab50-245a-4366-872c-42cbc8a4c903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:22.703680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412ab50-245a-4366-872c-42cbc8a4c903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:22.705234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412ab50-245a-4366-872c-42cbc8a4c903 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:22.714069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17533424-59f7-4603-8039-fd9a2e61511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:22.714866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533424-59f7-4603-8039-fd9a2e61511f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.715155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533424-59f7-4603-8039-fd9a2e61511f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.715530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533424-59f7-4603-8039-fd9a2e61511f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.722830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 397/794] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:22.722830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eaabc-58ce-4dcd-8e62-8c7553c2c391 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.722830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eaabc-58ce-4dcd-8e62-8c7553c2c391 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.722830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eaabc-58ce-4dcd-8e62-8c7553c2c391 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.722830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 398/795] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:22.722830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b3f0c-2269-4c5e-9bbb-7e15d9bde497 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.723306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b3f0c-2269-4c5e-9bbb-7e15d9bde497 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.723306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b3f0c-2269-4c5e-9bbb-7e15d9bde497 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.727344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 399/796] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:22.727344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b3f0c-2269-4c5e-9bbb-7e15d9bde497 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.734994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17533424-59f7-4603-8039-fd9a2e61511f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-17533424-59f7-4603-8039-fd9a2e61511f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:22.742754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:22.750023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 398/797] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:22.750881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64d7b7-d5c6-49a6-981a-56f2740023c4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.751690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64d7b7-d5c6-49a6-981a-56f2740023c4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.751690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64d7b7-d5c6-49a6-981a-56f2740023c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.767352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ad64d7b7-d5c6-49a6-981a-56f2740023c4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:22.768715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ad64d7b7-d5c6-49a6-981a-56f2740023c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:22.852870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 399/798] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:22.855212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba49cf-91f5-4ce9-b7be-79c052e5852a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.855527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba49cf-91f5-4ce9-b7be-79c052e5852a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.855794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba49cf-91f5-4ce9-b7be-79c052e5852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.866812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b3f0c-2269-4c5e-9bbb-7e15d9bde497 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:22.880049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e7ba49cf-91f5-4ce9-b7be-79c052e5852a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:22.881539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e7ba49cf-91f5-4ce9-b7be-79c052e5852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:22.904084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:22.905069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:22.905423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:22.905712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/edc00ecebf0c451b94b56e3e97254010/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:22.907716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=edc00ecebf0c451b94b56e3e97254010, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:22.909175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:22.924453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 400/799] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:22 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/edc00ecebf0c451b94b56e3e97254010/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:22.928144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.959008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 400/800] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:22.960434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba49cf-91f5-4ce9-b7be-79c052e5852a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:22.970328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:22.993092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.054448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d847c5-1175-48c2-b713-b1b3601605e2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.080544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba49cf-91f5-4ce9-b7be-79c052e5852a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.095334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.096112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.096358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.096655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.097415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:23.097731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.099872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.110383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 401/801] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:23.111392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.124485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.125307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.125597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.126488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.127158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.128976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:23.142238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:23.143307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:23.144252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 401/802] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jun 23 13:34:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:23.145124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.239527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.244980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2da5-8688-4ce6-80d8-109d8864261b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.250456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.262441 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b9a26-3af6-4578-8a7c-865f333f167a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.288540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.289697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.290050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.290533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.299662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.300649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.300988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.301274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.303747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:23.311618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:23.312611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:23.313478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:23.314140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.314215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 402/803] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:23.314215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.314844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:23.338556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:23.341354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:23.343637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:23.343637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:23.343637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:23.343637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:23.343637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 402/804] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:23.343637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.420203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497c09c-00e9-4b42-b92b-a4c1e5ff07c8 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.454791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5e2c-a2e3-492f-879f-5cc1a9bac4a2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.455128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.455766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.456052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.456329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.457036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:23.457345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.458723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.464419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 403/805] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:23.465286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.491532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.494194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.494844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.495912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.496137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.497780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:23.498102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.499668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.513857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 403/806] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:23.514744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.518957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.571086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade01f-b51a-4897-875b-c0b0b47c78d7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.607545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.608391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.608539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.608760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.609485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:23.609836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.611168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.624145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 404/807] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:23.624968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.629787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf77d8-8013-48a4-ab83-c5200cf8aeca None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.667971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.669096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.669596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.670091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.671143 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:23.671656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.673281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.679383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 404/808] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:23.680578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.709297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.729106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199117fe-d6b1-4f5a-8a3a-2c406ad91efe None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.757067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.770480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.771308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.771596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.771873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.782118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.783604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.796009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd882a9-e329-41af-895c-760032be10c8 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:23.801395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:23.802307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:23.808920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:23.808920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:23.808920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:23.808920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:23.808920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 405/809] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:23.808920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.836848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3beba-cd6d-4aa4-9a02-7602c461e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.837660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3beba-cd6d-4aa4-9a02-7602c461e62f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.837947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3beba-cd6d-4aa4-9a02-7602c461e62f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.838231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3beba-cd6d-4aa4-9a02-7602c461e62f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.847457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3beba-cd6d-4aa4-9a02-7602c461e62f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.848903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3beba-cd6d-4aa4-9a02-7602c461e62f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-6ae3beba-cd6d-4aa4-9a02-7602c461e62f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:23.863188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:23.864236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:23.865210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:23.869111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 405/810] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:23.870904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dadca-9499-42bf-89bd-cd41b71686e2 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.871228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dadca-9499-42bf-89bd-cd41b71686e2 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.871511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dadca-9499-42bf-89bd-cd41b71686e2 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.875247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 406/811] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:23.875247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dadca-9499-42bf-89bd-cd41b71686e2 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:23.921890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0d192-4b26-4f41-8942-2b7f327b5d94 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.961291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:23.962621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:23.963397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:23.963861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:23.965359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:23.967393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:23.972527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:23.974857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dadca-9499-42bf-89bd-cd41b71686e2 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:23.993587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 406/812] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:23.994401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.007798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:24.025455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b2b98-4e23-49a8-b8f8-6decefffd712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.026130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b2b98-4e23-49a8-b8f8-6decefffd712 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.026412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b2b98-4e23-49a8-b8f8-6decefffd712 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.027241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b2b98-4e23-49a8-b8f8-6decefffd712 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.027974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b2b98-4e23-49a8-b8f8-6decefffd712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:24.028283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b2b98-4e23-49a8-b8f8-6decefffd712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.029751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b2b98-4e23-49a8-b8f8-6decefffd712 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.044560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 407/813] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:24.045982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8f0f-b974-420f-8025-2430bb69a8b2 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.046274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8f0f-b974-420f-8025-2430bb69a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.046551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8f0f-b974-420f-8025-2430bb69a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.063902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-560a8f0f-b974-420f-8025-2430bb69a8b2 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:24.065262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-560a8f0f-b974-420f-8025-2430bb69a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:24.133382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06de475-7fb8-4939-8f9b-e258bc7e899b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.151338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 408/814] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:24.152414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a8f0f-b974-420f-8025-2430bb69a8b2 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.174348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.175051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.175373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.175653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.176514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:24.176826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.178296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.203284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 407/815] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 23 13:34:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:24.203284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.269490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:24.298476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a8f0f-b974-420f-8025-2430bb69a8b2 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.314738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:24.336081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574823f6-7a90-4e44-83d6-941ff61389a4 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.343818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.344542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.344828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.345113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.355678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.357752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.376093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:24.376828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:24.377748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:24.378694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:24.384046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 409/816] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:24.384046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.384912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.385423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.385999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] PATH_INFO: `/v3/services/network` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.386881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.388546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:24.402485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:24.403507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 13:34:24.404363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:24.408305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 408/817] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:24.409405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.505938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784762-538b-491c-8899-4f938fdc2512 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.554228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832a6e-6db4-4a1d-af1a-c244791b6266 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.557975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.559451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.559907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.560761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.562954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:24.575717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.578178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.590303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.590987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.591301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.591592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.592690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:24.593005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.594434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:24.601500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:24.602568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:24.603612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:24.603612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:24.603612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:24.603612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:24.610259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 410/818] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:24.610259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.621210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 409/819] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:24.631222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.654614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:24.742315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fbaa1-766e-40c2-ac15-f85b21e71f72 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.744687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb901bd-2d97-4ced-8828-1ca538a0a069 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.781402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.782567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.782955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.783438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.784494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:24.785008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.786161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.786691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.787166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.787637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.788063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:24.789139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] RBAC: Adding query filter params (name=network) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:24.790070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:24.791621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:24.800098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 411/820] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:24.801170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.806796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 410/821] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:24.808427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:24.850846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:24.923597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:24.936027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8529362-140f-44e5-803e-475eafd52184 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:24.977025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:24.977957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:24.978500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:24.978959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.054915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335741f9-8838-419c-b973-96fa8280c34f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.064716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.067251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.091709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.092525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.092913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.093311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.094119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] RBAC: Adding query filter params (type=network) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:25.094528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.096061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.106947 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 411/822] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:25.106947 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.180793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:25.191965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 412/823] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:34:25.193428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.215608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:25.223269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9d46-c03c-4a43-8304-23fef41fa440 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.258726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6634d5-e66f-478d-978f-386ec43ac94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.259552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6634d5-e66f-478d-978f-386ec43ac94f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.259849 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6634d5-e66f-478d-978f-386ec43ac94f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.260129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6634d5-e66f-478d-978f-386ec43ac94f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.267059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6634d5-e66f-478d-978f-386ec43ac94f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.268549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6634d5-e66f-478d-978f-386ec43ac94f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-ed6634d5-e66f-478d-978f-386ec43ac94f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:25.283328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:25.284664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:25.285559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 412/824] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:25.286037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0386453-c6a9-451f-b3b5-f6bda3da75b7 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.286037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0386453-c6a9-451f-b3b5-f6bda3da75b7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.286486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0386453-c6a9-451f-b3b5-f6bda3da75b7 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.287689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 413/825] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:25.288214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0386453-c6a9-451f-b3b5-f6bda3da75b7 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.309174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ecd68-b8bc-44ad-a17f-ab1ca2ad82f3 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.344951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.345669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.345960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.346239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.346967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.348389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.375239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 413/826] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:25.375239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.407601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0386453-c6a9-451f-b3b5-f6bda3da75b7 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.440474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:25.446492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9641677-da8d-47a6-ae09-0e94e8856981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.447449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9641677-da8d-47a6-ae09-0e94e8856981 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.447888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9641677-da8d-47a6-ae09-0e94e8856981 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.448181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9641677-da8d-47a6-ae09-0e94e8856981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.460312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9641677-da8d-47a6-ae09-0e94e8856981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.465708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9641677-da8d-47a6-ae09-0e94e8856981 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-a9641677-da8d-47a6-ae09-0e94e8856981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:25.491349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:25.492318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:25.493229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:25.493229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:25.493229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:25.493229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:25.495813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 414/827] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:25.497380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f625-d675-4303-9ebc-6ba5359e15d7 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.497853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f625-d675-4303-9ebc-6ba5359e15d7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.498314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f625-d675-4303-9ebc-6ba5359e15d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.504019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:25.511959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238f16c-aab0-481d-b6c3-90b488f6a126 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.518592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0423f625-d675-4303-9ebc-6ba5359e15d7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:25.519981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0423f625-d675-4303-9ebc-6ba5359e15d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:25.558707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.559524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.559907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.560313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.561064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:25.562128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.562827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.578325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 414/828] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:25.579161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.603853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 415/829] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:25.604927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f625-d675-4303-9ebc-6ba5359e15d7 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.703812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91b56-72ee-4a13-8dc7-9acdf767d3d2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.711588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:25.728753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f625-d675-4303-9ebc-6ba5359e15d7 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.741879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.742556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.742847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.743132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.743908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:25.744212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.745618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.757328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 415/830] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:25.758126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.765306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:25.771047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.771974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.772254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.772531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/2fe7a2fd38f74ed6b5e2f3a1af29a3cc/roles/fae6b286f5584beb868e5087cbf3d351` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.788698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc, role_id=fae6b286f5584beb868e5087cbf3d351)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:25.790128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:25.804374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 416/831] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:25 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/2fe7a2fd38f74ed6b5e2f3a1af29a3cc/roles/fae6b286f5584beb868e5087cbf3d351 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:25.805219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.889111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40717-918c-4cc7-9a7e-b6042aec7c77 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.928379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:25.929557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:25.930082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:25.930428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:25.942970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:25.948446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9e88-01c2-4cc1-b922-996837f1c450 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:25.951129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:25.952180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:25.953027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:25.957533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 416/832] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:25.958557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:25.990167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.000260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.001563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.001857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.002136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.012411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.014397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:26.029772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:26.030715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:26.031659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:26.035400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 417/833] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:26.038955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.089021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611dc7-e98c-4ef8-8c8b-a511783d70ec None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.111634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.125391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.126405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.126901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.127424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.128385 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:26.128944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.130573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.140847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 417/834] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:26.146825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.155032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba0cc5-becb-4dd5-aa30-eaa25c8087c7 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.195075 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20a742-87f9-4692-9ff3-ba50970668f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.195892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20a742-87f9-4692-9ff3-ba50970668f2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.196247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20a742-87f9-4692-9ff3-ba50970668f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.196595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20a742-87f9-4692-9ff3-ba50970668f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.197461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20a742-87f9-4692-9ff3-ba50970668f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:26.197775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20a742-87f9-4692-9ff3-ba50970668f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.199781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20a742-87f9-4692-9ff3-ba50970668f2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.212484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 418/835] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:26.213630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d4b37-e4db-406e-b876-0c8444959137 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.213911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d4b37-e4db-406e-b876-0c8444959137 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.214188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d4b37-e4db-406e-b876-0c8444959137 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.219245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 419/836] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:26.219245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d4b37-e4db-406e-b876-0c8444959137 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.252207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.267347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda383c-51bb-42d5-8314-1bf8bdca3491 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.304986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78db7ab-088f-4eb3-a3b4-c2ee28c46f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.306354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db7ab-088f-4eb3-a3b4-c2ee28c46f47 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.307159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db7ab-088f-4eb3-a3b4-c2ee28c46f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.308471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db7ab-088f-4eb3-a3b4-c2ee28c46f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.321980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78db7ab-088f-4eb3-a3b4-c2ee28c46f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.324036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78db7ab-088f-4eb3-a3b4-c2ee28c46f47 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.329104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d4b37-e4db-406e-b876-0c8444959137 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.331191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d78db7ab-088f-4eb3-a3b4-c2ee28c46f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:26.340968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:26.341912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:26.343524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:26.343524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:26.343524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:26.343524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:26.343524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 418/837] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:26.343820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e7b3-b26d-49b0-ad6a-b8cfc7e9fb6a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.344035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e7b3-b26d-49b0-ad6a-b8cfc7e9fb6a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.344302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8e7b3-b26d-49b0-ad6a-b8cfc7e9fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.361220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-98d8e7b3-b26d-49b0-ad6a-b8cfc7e9fb6a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:26.362400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-98d8e7b3-b26d-49b0-ad6a-b8cfc7e9fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:26.373595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.374580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.374875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.375456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.376348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=8aae95f970644f279053e3f140353481, user.id=c37e7d70e2864edaa125e8f5ac1a3373) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:26.376857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.378969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.391711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 420/838] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/role_assignments?user.id=c37e7d70e2864edaa125e8f5ac1a3373&scope.project.id=8aae95f970644f279053e3f140353481&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:26.393370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.456308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 419/839] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:26.482017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8e7b3-b26d-49b0-ad6a-b8cfc7e9fb6a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.546845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caaef6-6b0a-4231-bf6b-21ea3aeca21a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.567467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.598781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.599485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.599773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.600053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.600890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:26.601199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.602699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.609115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8e7b3-b26d-49b0-ad6a-b8cfc7e9fb6a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.615712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 421/840] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:26.621077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.653629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.654730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.655189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.655665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.656489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.657278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.658237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:26.671272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:26.672283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:26.673131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:26.675739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 420/841] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:26.682130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.743300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6d2c-751f-41ba-841d-9b7ccf0e67c9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.777954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.778770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.779053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.779361 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.787362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.788793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.800780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1774e-dbba-4bdc-aeea-f7140e005baf None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:26.802864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:26.803813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:26.804775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 422/842] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:26.810839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.842660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.843719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.844214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.844697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.845775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:26.846291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.847991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.849270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.860222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 421/843] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:26.861468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:26.897481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:26.913212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305557f-aca1-4bd3-bbe3-89798709ae2b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.952291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:26.953380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:26.954357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:26.954856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:26.956381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:26.957179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:26.959578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:26.981198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4760e8-6f6d-40c2-aada-343efd224f99 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:26.983499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 423/844] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:26.989843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:27.027151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:27.027854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:27.028144 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:27.028430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:27.029255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:27.029575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:27.031065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:27.043311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 422/845] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:27.102812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a0be-78ac-4f46-bbc2-7e2d35659220 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:27.141680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:27.142761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:27.143303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:27.143777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:27.161192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:27.219602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:27.221428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:27.320146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 424/846] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:34:27.326483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:27.392551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:27.435815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590e23a-7d72-41ba-8d91-24abd5acfbce None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:27.471846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:27.472550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:27.472836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:27.473116 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:27.491235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:27.491235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:27.506184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:27.507072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:27.508013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:27.508013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:27.508013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:27.508013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:27.508013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 423/847] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:27.513001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:27.565576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:27.624213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b62d-5c30-4400-af4d-eea0b9ad5737 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:27.660159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:27.661194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:27.661706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:27.662179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:27.663144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:27.663687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:27.665296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:27.677861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 425/848] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:27.685839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:27.786075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19eefa-348a-4786-99e9-7414c3050d9f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:27.801032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:27.827034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18969-78ea-4945-a505-1e70041e14ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:27.827869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18969-78ea-4945-a505-1e70041e14ab None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:27.828160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18969-78ea-4945-a505-1e70041e14ab None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:27.828447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18969-78ea-4945-a505-1e70041e14ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:27.835318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18969-78ea-4945-a505-1e70041e14ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:27.836768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18969-78ea-4945-a505-1e70041e14ab None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-58f18969-78ea-4945-a505-1e70041e14ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:27.851462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:27.852372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:27.853281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 424/849] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:27.860428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:27.962496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08651b-c570-496e-bf90-d58ab9780256 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:27.962835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08651b-c570-496e-bf90-d58ab9780256 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:27.963088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08651b-c570-496e-bf90-d58ab9780256 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:27.964753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 425/850] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:27.969046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee98305-ea01-4a32-b6f8-0a2a2ccef0fd None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:27.973611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:27.975485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408eca5-8a88-4d1a-9aff-3746cb877159 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:27.975982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408eca5-8a88-4d1a-9aff-3746cb877159 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:27.976457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408eca5-8a88-4d1a-9aff-3746cb877159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:27.996819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4408eca5-8a88-4d1a-9aff-3746cb877159 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:27.998420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4408eca5-8a88-4d1a-9aff-3746cb877159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:28.011492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.012168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.012460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.012743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.013687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:28.014014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:28.015882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:28.035329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 426/851] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:28.037996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.085730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 426/852] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:28.110479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408eca5-8a88-4d1a-9aff-3746cb877159 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.149803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c0071-95c1-4ec2-93d2-d11ce4853524 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:28.187099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.188160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.188689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.189275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.190293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=8aae95f970644f279053e3f140353481, user.id=edc00ecebf0c451b94b56e3e97254010) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:28.191009 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:28.192859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:28.207157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 427/853] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/role_assignments?user.id=edc00ecebf0c451b94b56e3e97254010&scope.project.id=8aae95f970644f279053e3f140353481&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:28.239478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408eca5-8a88-4d1a-9aff-3746cb877159 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:28.242174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:28.282525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.283910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.284454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.284976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.297594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:28.306057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:28.307058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:34:28.308459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:28.315353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 427/854] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:28.317557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.349739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:28.428485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293f43-cba2-425b-b322-316d1e6c5130 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:28.466108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487f91e-afb6-419c-b31d-8bd60efe2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.467060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487f91e-afb6-419c-b31d-8bd60efe2e1b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.467524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487f91e-afb6-419c-b31d-8bd60efe2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.467936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487f91e-afb6-419c-b31d-8bd60efe2e1b None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.468818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487f91e-afb6-419c-b31d-8bd60efe2e1b None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:28.469260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487f91e-afb6-419c-b31d-8bd60efe2e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:28.470787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487f91e-afb6-419c-b31d-8bd60efe2e1b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:28.479863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 428/855] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:28.485562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.535435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081b0f-e5f7-4203-aa52-b10296a7c078 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.535982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081b0f-e5f7-4203-aa52-b10296a7c078 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.535982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081b0f-e5f7-4203-aa52-b10296a7c078 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.538570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 429/856] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:28.542551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1ef3-430d-40c0-9a5f-8b080e5977cf None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.542842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1ef3-430d-40c0-9a5f-8b080e5977cf None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.543125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1ef3-430d-40c0-9a5f-8b080e5977cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.560976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-542b1ef3-430d-40c0-9a5f-8b080e5977cf None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:28.562186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-542b1ef3-430d-40c0-9a5f-8b080e5977cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:28.594055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb227-e54c-49cf-8071-753f229353f5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:28.630698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.631536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.631829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.632113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.643426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 430/857] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:28.644365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:28.645831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:28.662963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b1ef3-430d-40c0-9a5f-8b080e5977cf None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:28.663286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:28.664157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:28.665679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:28.665679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:28.665679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:28.665679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:28.665679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 428/858] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:28.670717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.689282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:28.693943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:28.770332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b1ef3-430d-40c0-9a5f-8b080e5977cf None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:28.803322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1407-d345-4244-b987-f0450e1fc8c6 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:28.806419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254efd42-8389-4176-898e-03db40d1338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.807326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254efd42-8389-4176-898e-03db40d1338c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.807706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254efd42-8389-4176-898e-03db40d1338c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.808483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254efd42-8389-4176-898e-03db40d1338c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.809142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254efd42-8389-4176-898e-03db40d1338c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:28.810525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254efd42-8389-4176-898e-03db40d1338c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-254efd42-8389-4176-898e-03db40d1338c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:28.822746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:28.825835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:28.826698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:28.829695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 431/859] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:28.830538 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254efd42-8389-4176-898e-03db40d1338c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.847061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.848052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.848625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.849106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.850137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:28.850624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:28.852331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:28.871361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 429/860] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:28.873317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:28.931253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:28.950517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254efd42-8389-4176-898e-03db40d1338c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:28.971059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:28.988590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:28.989575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:28.990030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:28.990535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:28.991416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:28.991867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:28.993569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:28.999679 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 432/861] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:29.004923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea52b-192a-4de4-ab70-19d65dc40e78 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:29.007307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:29.048881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:29.050725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.051257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.051959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.062018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:29.064208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:29.085752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:29.086805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:29.087782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:29.095528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 430/862] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:34:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:29.096572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:29.136963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b092b4f-42bd-4680-828b-9a9d32bbfae8 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:29.180383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eda2e-3166-421a-8548-b7596c2f2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:29.181052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eda2e-3166-421a-8548-b7596c2f2a6f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.181337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eda2e-3166-421a-8548-b7596c2f2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.181616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eda2e-3166-421a-8548-b7596c2f2a6f None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.182317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eda2e-3166-421a-8548-b7596c2f2a6f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:29.182651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eda2e-3166-421a-8548-b7596c2f2a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:29.184052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eda2e-3166-421a-8548-b7596c2f2a6f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:29.188829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 433/863] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:29.191240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e80c5-5130-4d9a-80c4-bed95cc30575 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.191240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e80c5-5130-4d9a-80c4-bed95cc30575 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.191240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e80c5-5130-4d9a-80c4-bed95cc30575 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.192057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 434/864] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:29.201203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec516fe3-190e-4bf0-8509-4f36fcb326f8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.201495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec516fe3-190e-4bf0-8509-4f36fcb326f8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.201779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec516fe3-190e-4bf0-8509-4f36fcb326f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.207343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950725-02b2-43e2-bf38-113d824e70a5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:29.224252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-ec516fe3-190e-4bf0-8509-4f36fcb326f8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:29.226080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ec516fe3-190e-4bf0-8509-4f36fcb326f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:29.240413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:29.256130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:29.257153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.257644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.258119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.259148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:29.259667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:29.261564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:29.265675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:29.285911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 431/865] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 23 13:34:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:29.291273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:29.329369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 435/866] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:29.357087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec516fe3-190e-4bf0-8509-4f36fcb326f8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:29.422775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75661164-bc24-4ee5-979b-0c83dc3ada6c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:29.471294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:29.472554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.472848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.473294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.488554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec516fe3-190e-4bf0-8509-4f36fcb326f8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:29.525998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:29.527625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.528121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.528604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.529550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:29.531138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:29.547128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 436/867] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:29 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:29.567005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:29.569332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:29.571163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:29.686817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 432/868] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:34:29.696363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:29.700012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:29.815899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d6a7-50a4-4c19-9056-9bccfa6a9c9d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:29.851022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:29.851866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:29.852153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:29.852430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:29.863510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:29.864996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:29.883474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:29.884422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:29.885320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:29.885320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:29.885320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:29.885320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:29.885320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 437/869] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:29.892568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:30.107590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:30.114866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a439b20-0b9b-4068-bcfb-c808965e517e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:30.150254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:30.151260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.152281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.152751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.153684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:30.154183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:30.155778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:30.167693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 433/870] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:30.173269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:30.225753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:30.278066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798393d-bd5f-4fd7-b6ee-fb7e0b286d3b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:30.313493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a95e6-1528-4462-bf58-dba2bcaf1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:30.314300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a95e6-1528-4462-bf58-dba2bcaf1131 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.314590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a95e6-1528-4462-bf58-dba2bcaf1131 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.314874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a95e6-1528-4462-bf58-dba2bcaf1131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.321976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a95e6-1528-4462-bf58-dba2bcaf1131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:30.323991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a95e6-1528-4462-bf58-dba2bcaf1131 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-999a95e6-1528-4462-bf58-dba2bcaf1131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:30.339688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:30.340618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:30.341505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 438/871] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:30.348200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:30.425010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4fe4-3be7-4faf-a33e-20061f9ce7e0 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.425311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4fe4-3be7-4faf-a33e-20061f9ce7e0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.425494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4fe4-3be7-4faf-a33e-20061f9ce7e0 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.428238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 439/872] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:30.432403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d262928-93cb-4b66-b8d4-2df7f5592549 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.432528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d262928-93cb-4b66-b8d4-2df7f5592549 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.433450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d262928-93cb-4b66-b8d4-2df7f5592549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.452938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2d262928-93cb-4b66-b8d4-2df7f5592549 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:30.455068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2d262928-93cb-4b66-b8d4-2df7f5592549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:30.457010 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e7fe-e1b3-4b3f-b48e-8060441156c9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:30.493509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:30.494276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.494747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.495794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.496795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:30.497221 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:30.498836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:30.517166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 434/873] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:30.518432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:30.535905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:30.555317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 440/874] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:30.570428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d262928-93cb-4b66-b8d4-2df7f5592549 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:30.622053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:30.636079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa788d3-8cd7-470a-b364-40a285370357 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:30.674356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:30.674984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.675346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.675588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.676412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:30.676726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:30.678267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:30.684518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d262928-93cb-4b66-b8d4-2df7f5592549 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:30.685518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 435/875] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:30 2022] GET /identity/v3/role_assignments?user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:30.734113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:30.734938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.735243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.735529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.736249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:30.737706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:30.750899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:30.752041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:30.752898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:30.757411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 441/876] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:30.758853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:30.853309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:30.877767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbedf77-25c9-49d8-98d1-a6120de881c6 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:30.914312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695055f7-6e41-42a7-8ab0-6d94f83ae7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:30.914977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695055f7-6e41-42a7-8ab0-6d94f83ae7ce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:30.915293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695055f7-6e41-42a7-8ab0-6d94f83ae7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:30.915575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695055f7-6e41-42a7-8ab0-6d94f83ae7ce None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:30.916282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695055f7-6e41-42a7-8ab0-6d94f83ae7ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:30.916600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695055f7-6e41-42a7-8ab0-6d94f83ae7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:30.918552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695055f7-6e41-42a7-8ab0-6d94f83ae7ce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:30.924873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 436/877] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:30.930689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:31.037714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2151-bb7e-4d81-8611-6b418cc4a3a6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:31.040071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:31.074438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6c7ac-5bea-4067-8ff1-8bf41e992e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:31.075105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c7ac-5bea-4067-8ff1-8bf41e992e9b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:31.075421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c7ac-5bea-4067-8ff1-8bf41e992e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:31.075699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c7ac-5bea-4067-8ff1-8bf41e992e9b None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:31.076407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6c7ac-5bea-4067-8ff1-8bf41e992e9b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:31.076714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6c7ac-5bea-4067-8ff1-8bf41e992e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:31.078081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6c7ac-5bea-4067-8ff1-8bf41e992e9b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:31.086672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 442/878] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:31.290905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de00a3-b0e7-403c-8a08-1b6c97eaf65f None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:31.291093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de00a3-b0e7-403c-8a08-1b6c97eaf65f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:31.291413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de00a3-b0e7-403c-8a08-1b6c97eaf65f None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:31.293032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 437/879] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:31.298426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3400fd-f8f1-472b-964c-aceac9fe8223 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:31.298718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3400fd-f8f1-472b-964c-aceac9fe8223 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:31.298997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3400fd-f8f1-472b-964c-aceac9fe8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:31.315978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5c3400fd-f8f1-472b-964c-aceac9fe8223 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:31.317151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5c3400fd-f8f1-472b-964c-aceac9fe8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:31.384544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 443/880] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:31.407821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de00a3-b0e7-403c-8a08-1b6c97eaf65f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:31.516096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de00a3-b0e7-403c-8a08-1b6c97eaf65f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:31.551478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1356fdd-4010-4187-aa53-38805c90e997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:31.552069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1356fdd-4010-4187-aa53-38805c90e997 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:31.552356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1356fdd-4010-4187-aa53-38805c90e997 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:31.552638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1356fdd-4010-4187-aa53-38805c90e997 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:31.553371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1356fdd-4010-4187-aa53-38805c90e997 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:31.554730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1356fdd-4010-4187-aa53-38805c90e997 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:31.572222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 438/881] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:31 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:31.765793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9567-21cb-4097-9b42-53a03913cb44 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:31.766583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9567-21cb-4097-9b42-53a03913cb44 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:31.766583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9567-21cb-4097-9b42-53a03913cb44 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:31.768246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 444/882] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:31.773455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dac46-b587-43a5-a032-5f010b006eef None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:31.773891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dac46-b587-43a5-a032-5f010b006eef None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:31.774074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dac46-b587-43a5-a032-5f010b006eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:31.779973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:31.793929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-283dac46-b587-43a5-a032-5f010b006eef None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:31.795947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-283dac46-b587-43a5-a032-5f010b006eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:31.875317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 439/883] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:31.895171 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9567-21cb-4097-9b42-53a03913cb44 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:32.002638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:32.008329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9567-21cb-4097-9b42-53a03913cb44 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:32.045197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:32.046001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:32.046285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:32.046561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:32.047231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:32.048664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:32.061647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:32.062660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:32.063684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 445/884] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:32.071184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dac46-b587-43a5-a032-5f010b006eef None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:32.173316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dac46-b587-43a5-a032-5f010b006eef None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:32.199664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:32.208275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:32.209242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:32.209730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:32.210207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:32.211115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:32.211672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:32.213227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:32.223313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 440/885] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:32.225722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:32.332011 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d107-a72a-490d-aef4-1ed57ed84ac2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:32.366797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:32.367492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:32.367780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:32.368068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:32.368767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:32.369076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:32.370988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:32.376275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 446/886] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:32.381995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:32.485036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5bb79-74ae-4aab-ba94-78e5d1e034ef None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:32.520214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad9953-e6c3-45e2-bfca-b29ca129c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:32.521192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad9953-e6c3-45e2-bfca-b29ca129c788 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:32.521682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad9953-e6c3-45e2-bfca-b29ca129c788 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:32.522160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad9953-e6c3-45e2-bfca-b29ca129c788 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:32.523158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad9953-e6c3-45e2-bfca-b29ca129c788 None admin] RBAC: Adding query filter params (interface=public, service_id=beb660d308a84c02badb8ffd6ee8101f, region_id=RegionOne) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:32.523701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad9953-e6c3-45e2-bfca-b29ca129c788 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:32.525288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad9953-e6c3-45e2-bfca-b29ca129c788 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:32.535303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 441/887] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:34:32 2022] GET /identity/v3/endpoints?service_id=beb660d308a84c02badb8ffd6ee8101f&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:32.537307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:32.565275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:32.642027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091582-0745-4af2-af65-f5b4f35a98da None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:32.676067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45949a-3340-4250-9a49-342c5fea1867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:32.676738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45949a-3340-4250-9a49-342c5fea1867 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:32.677024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45949a-3340-4250-9a49-342c5fea1867 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:32.677303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45949a-3340-4250-9a49-342c5fea1867 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:32.677994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45949a-3340-4250-9a49-342c5fea1867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:32.679402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45949a-3340-4250-9a49-342c5fea1867 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:32.685710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 447/888] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:32 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:34:32.927695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb202-37f5-4b4e-9afc-e9782a93edbb None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:32.928656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb202-37f5-4b4e-9afc-e9782a93edbb None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:32.929154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb202-37f5-4b4e-9afc-e9782a93edbb None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:32.930936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 442/889] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:32.936707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db90c9-4401-429e-bc56-78fb7917facf None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:32.937508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db90c9-4401-429e-bc56-78fb7917facf None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:32.937985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db90c9-4401-429e-bc56-78fb7917facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:32.955376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-57db90c9-4401-429e-bc56-78fb7917facf None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:32.956950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-57db90c9-4401-429e-bc56-78fb7917facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:33.023655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 448/890] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:33.047939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fb202-37f5-4b4e-9afc-e9782a93edbb None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:33.105430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:33.149887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fb202-37f5-4b4e-9afc-e9782a93edbb None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:33.184300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e99ee-ac5c-4475-9970-7f80787510ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:33.185038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e99ee-ac5c-4475-9970-7f80787510ac None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.185326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e99ee-ac5c-4475-9970-7f80787510ac None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.185611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e99ee-ac5c-4475-9970-7f80787510ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.196609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e99ee-ac5c-4475-9970-7f80787510ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b94e99ee-ac5c-4475-9970-7f80787510ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:33.205655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:33.206614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:33.207510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 443/891] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 23 13:34:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:33.212890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db90c9-4401-429e-bc56-78fb7917facf None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:33.231141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7664-6527-419b-88dc-d86cb26dd56f None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.231474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7664-6527-419b-88dc-d86cb26dd56f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.232509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7664-6527-419b-88dc-d86cb26dd56f None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.233441 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 444/892] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:33.238195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a9ed3-c036-431b-8565-62a91af1fe7f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.238489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a9ed3-c036-431b-8565-62a91af1fe7f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.238771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a9ed3-c036-431b-8565-62a91af1fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.242277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:33.259761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-713a9ed3-c036-431b-8565-62a91af1fe7f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:33.261556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-713a9ed3-c036-431b-8565-62a91af1fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:33.320001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db90c9-4401-429e-bc56-78fb7917facf None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:33.353212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 445/893] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:33.362284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:33.363311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.363800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.364313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.365274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:33.365781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:33.367455 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:33.377670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a9ed3-c036-431b-8565-62a91af1fe7f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:33.380164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 449/894] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 23 13:34:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:33.385020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:33.443453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:33.474256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:33.499234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5b06-1f6a-4710-ab09-cfb73acea9db None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:33.512669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a9ed3-c036-431b-8565-62a91af1fe7f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:33.546349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2b0e-6f81-4c9a-858c-010f7593bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:33.547150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2b0e-6f81-4c9a-858c-010f7593bc1a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.547484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2b0e-6f81-4c9a-858c-010f7593bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.547761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2b0e-6f81-4c9a-858c-010f7593bc1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.549762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:33.550657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.551150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.551673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.552639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:33.554257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:33.559848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d2b0e-6f81-4c9a-858c-010f7593bc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:33.561294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d2b0e-6f81-4c9a-858c-010f7593bc1a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:33.570473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 446/895] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:33 2022] POST /identity/v3/services => generated 241 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-ce0d2b0e-6f81-4c9a-858c-010f7593bc1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:33.583865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:33.584875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:33.585794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:33.585794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:33.585794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:33.585794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:33.588350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 450/896] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:33.595336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:33.724928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8ea4-fe54-4de0-b0f2-79838b6f1c44 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.725229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8ea4-fe54-4de0-b0f2-79838b6f1c44 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.725408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8ea4-fe54-4de0-b0f2-79838b6f1c44 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.728091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 451/897] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:33.732896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc4c3c-2914-4ec2-bb48-80677b015c9b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.733195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc4c3c-2914-4ec2-bb48-80677b015c9b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.733477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc4c3c-2914-4ec2-bb48-80677b015c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.734151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b652-8f99-468c-8aad-833322af4809 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:33.735753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:33.753500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5bcc4c3c-2914-4ec2-bb48-80677b015c9b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:33.755030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5bcc4c3c-2914-4ec2-bb48-80677b015c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:33.779295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:33.779963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.781042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.781650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.782043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:33.782349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:33.783811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:33.798920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 447/898] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:33.804824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:33.844024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 452/899] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:33.867273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc4c3c-2914-4ec2-bb48-80677b015c9b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:33.929193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902c23-e46f-483e-a0b3-512b6b0a9041 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:33.947103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:33.972270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:33.973457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:33.973808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:33.974156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:33.984580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:33.986794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:33.992068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc4c3c-2914-4ec2-bb48-80677b015c9b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:34.003796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:34.004784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:34.005734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 448/900] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:34:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:34.011879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.032919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.033788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.034079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.034350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.035002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.036653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.039958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:34.051779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:34.052720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:34.053571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:34.058363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 453/901] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jun 23 13:34:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:34.059768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.135367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398f737-8348-4acc-9bd2-c9d47b8ee70d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.170143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c94c-5272-425f-b2ce-756114c213f3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.179522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.180973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.181848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.182613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.183698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:34.184461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.186876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.202946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:34.212424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 449/902] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:34.215968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.216945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.217429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.217981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.218890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.220024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:34.220554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.222345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.232786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 454/903] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:34.234313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.318513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:34.341317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f421e1-b8fa-4426-84bb-975b1e78ec4b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.353707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ab67-a0b3-4b22-bd92-2993cc6ab608 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.378930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.379973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.380462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.380973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.392543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.393206 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.393491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.393770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.394575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:34.394912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.396459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.406661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 455/904] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:34.408723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.475816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.477860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.488592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:34.547863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79b128-fd8e-4a28-9d11-e0ebf92f495d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.589065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:34.591282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.591963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.592246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.593978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.595018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] RBAC: Adding query filter params (interface=public, service_id=e1f237ad26b64363a708c5c9190baaa6, region_id=RegionOne) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:34.595365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.596750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.613756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 456/905] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/endpoints?service_id=e1f237ad26b64363a708c5c9190baaa6&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:34.616281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.627709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 450/906] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:34:34.629932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.731561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081272f-4670-4189-b4c4-8044aa0d57b9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.733216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4f063-c3e6-4336-b37f-3ec0d7c16241 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.756413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:34.779748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.780986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.781443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8c13a-8c8a-47ac-a23e-abb82a47fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:34.781662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.782111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.782274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c13a-8c8a-47ac-a23e-abb82a47fe1b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.782688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c13a-8c8a-47ac-a23e-abb82a47fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.783092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c13a-8c8a-47ac-a23e-abb82a47fe1b None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.783909 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8c13a-8c8a-47ac-a23e-abb82a47fe1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.785771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8c13a-8c8a-47ac-a23e-abb82a47fe1b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.795240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 457/907] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:34:34.803467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:34.807640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:34.826749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:34.827938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:34.829035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:34.829035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:34.829035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:34.829035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:34.829313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01d4e0-f663-42ce-9e2e-c0ca4552f7b4 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.829313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01d4e0-f663-42ce-9e2e-c0ca4552f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.829313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01d4e0-f663-42ce-9e2e-c0ca4552f7b4 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.829796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 458/908] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:34.835520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 451/909] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:34.835712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22135f0-82d8-451f-8b64-23e137c93bfa None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:34.835712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22135f0-82d8-451f-8b64-23e137c93bfa None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:34.835879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22135f0-82d8-451f-8b64-23e137c93bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:34.838156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:34.856552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a22135f0-82d8-451f-8b64-23e137c93bfa None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:34.858257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a22135f0-82d8-451f-8b64-23e137c93bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:34.876242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:34.959645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83d959-b81a-4c85-8fd9-167269a74b8a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:34.965486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 459/910] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:34.989587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22135f0-82d8-451f-8b64-23e137c93bfa None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.000478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.000866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.001161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.001447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.002183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:35.002498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.003905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.017281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 452/911] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:35.022668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.120322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:35.126335 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22135f0-82d8-451f-8b64-23e137c93bfa None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:35.130041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2aa5-2868-4f59-9302-903b0c27886e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:35.163591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:35.173617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.174426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.174714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.174995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.175712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.176265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.177103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.177578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.178111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.178591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.186780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.188485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:35.189487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:35.190547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 13:34:35.191431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:35.195652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 460/912] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:35.197029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:35.209166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:35.210090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:35.211007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:35.212772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 453/913] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:35.220244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.316527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402d19-dd6e-478d-9801-38bd85eb66a1 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:35.345307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34832a-1495-42f9-9324-9bc46b476afc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:35.363468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.364823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.365344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.365851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.367324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:35.367872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.370665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.382500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 461/914] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:35.383392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.384830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.385596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.386476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.386848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.387877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:35.388260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.389899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.407476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 454/915] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:35.409568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.427270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:35.430916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:35.497486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1e2e-a11e-4bee-b741-83c2d3eed5e5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:35.531384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0444-4699-427a-a6bb-efcb584d8fae None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:35.538458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.539273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.539668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.540051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.540867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:35.541293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.543324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.553568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 462/916] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 23 13:34:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:35.554532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.577412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8243c-105b-4182-8664-80e23e483c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.578063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8243c-105b-4182-8664-80e23e483c8b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.578353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8243c-105b-4182-8664-80e23e483c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.578636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8243c-105b-4182-8664-80e23e483c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.579576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8243c-105b-4182-8664-80e23e483c8b None admin] RBAC: Adding query filter params (role.id=e8e71d6c1b3b4bfca8ce2509fc28017d, scope.project.id=8aae95f970644f279053e3f140353481, user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:35.579895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8243c-105b-4182-8664-80e23e483c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.581376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8243c-105b-4182-8664-80e23e483c8b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.595627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 455/917] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:35 2022] GET /identity/v3/role_assignments?user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc&scope.project.id=8aae95f970644f279053e3f140353481&role.id=e8e71d6c1b3b4bfca8ce2509fc28017d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:35.677753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70871403-fd41-4bb7-b835-ce5aa97f7139 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:35.686050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:35.718021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:35.719107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.719639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.720129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.721161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:35.722782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:35.728716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9af3b-3e2f-4d26-8850-e0f9e90322a2 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.729032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9af3b-3e2f-4d26-8850-e0f9e90322a2 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.729403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9af3b-3e2f-4d26-8850-e0f9e90322a2 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.730959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 456/918] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:35.736529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade51d7-39c4-4a6e-a82c-910511065bda None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:35.736813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade51d7-39c4-4a6e-a82c-910511065bda None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:35.737098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade51d7-39c4-4a6e-a82c-910511065bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:35.748363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 463/919] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:35.762871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0ade51d7-39c4-4a6e-a82c-910511065bda None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:35.764294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0ade51d7-39c4-4a6e-a82c-910511065bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:35.851803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 457/920] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:35.875916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:35.985461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3d25-4120-420e-8116-101dd7af4c43 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:36.022066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:36.022879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:36.023165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:36.023476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:36.024189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:36.025625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:36.038558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:36.039650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:36.040481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 464/921] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:36.048304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade51d7-39c4-4a6e-a82c-910511065bda None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:36.051268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:36.155793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade51d7-39c4-4a6e-a82c-910511065bda None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:36.190310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:36.191322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:36.191816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:36.192291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:36.193229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:36.193736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:36.195315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:36.201107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 458/922] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:36.206826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:36.236535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:36.359035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a568-aaf6-4e6c-becb-406d050cf401 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:36.455701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:36.456778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:36.457295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:36.457781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:36.458717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:36.459254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:36.461154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:36.472012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 465/923] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:36.488817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:36.619602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:36.701599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c0a27-cdbd-4e68-9630-a2252f2a1e1f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:36.752156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd108c-99a4-4f26-93e0-d8b60873ad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:36.752776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd108c-99a4-4f26-93e0-d8b60873ad54 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:36.753066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd108c-99a4-4f26-93e0-d8b60873ad54 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:36.753349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd108c-99a4-4f26-93e0-d8b60873ad54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:36.754163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd108c-99a4-4f26-93e0-d8b60873ad54 None admin] RBAC: Adding query filter params (interface=public, service_id=5987b81b02764636aa27f97970341262, region_id=RegionOne) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:36.754483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd108c-99a4-4f26-93e0-d8b60873ad54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:36.755906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd108c-99a4-4f26-93e0-d8b60873ad54 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:36.771685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 459/924] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:34:36 2022] GET /identity/v3/endpoints?service_id=5987b81b02764636aa27f97970341262&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:36.777508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:36.887988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:36.898184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec54d7-f73e-4e07-a5b1-9e56b47c1afc None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:36.933061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb3d3-53ef-4b80-aecc-2fd04ec4af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:36.933740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb3d3-53ef-4b80-aecc-2fd04ec4af79 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:36.934026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb3d3-53ef-4b80-aecc-2fd04ec4af79 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:36.934308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb3d3-53ef-4b80-aecc-2fd04ec4af79 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:36.934988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb3d3-53ef-4b80-aecc-2fd04ec4af79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:36.936416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb3d3-53ef-4b80-aecc-2fd04ec4af79 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:36.942686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 466/925] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:36 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:34:37.066847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512410eb-f8f7-47fc-9c81-cdc4674bcd0c None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.067455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512410eb-f8f7-47fc-9c81-cdc4674bcd0c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.067455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512410eb-f8f7-47fc-9c81-cdc4674bcd0c None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.069281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 460/926] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:37.075249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5390c5-236e-4574-8223-dc1efa806ac0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.075925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5390c5-236e-4574-8223-dc1efa806ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.075925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5390c5-236e-4574-8223-dc1efa806ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.093368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-dc5390c5-236e-4574-8223-dc1efa806ac0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:37.094563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dc5390c5-236e-4574-8223-dc1efa806ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:37.170647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 467/927] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:37.194726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512410eb-f8f7-47fc-9c81-cdc4674bcd0c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:37.299058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512410eb-f8f7-47fc-9c81-cdc4674bcd0c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:37.328930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:37.335227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:37.336035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.336319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.336600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.337470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:37.339690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:37.352341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:37.353338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:37.354284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 461/928] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jun 23 13:34:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:37.360204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5390c5-236e-4574-8223-dc1efa806ac0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:37.447175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:37.465637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5390c5-236e-4574-8223-dc1efa806ac0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:37.501753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:37.502481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.502770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.503099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.503890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:37.504211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:37.505598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:37.510759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 468/929] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:37.516686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:37.620510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b59b2-e5c5-43a0-8277-4ffc1d17fc3d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:37.656473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc7a0-d6dc-49cd-abfd-db3495ff59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:37.657501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc7a0-d6dc-49cd-abfd-db3495ff59c1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.658007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc7a0-d6dc-49cd-abfd-db3495ff59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.658477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc7a0-d6dc-49cd-abfd-db3495ff59c1 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.659423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc7a0-d6dc-49cd-abfd-db3495ff59c1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:37.659966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc7a0-d6dc-49cd-abfd-db3495ff59c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:37.661578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc7a0-d6dc-49cd-abfd-db3495ff59c1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:37.667135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 462/930] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:37.675254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:37.726221 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd1fe-923a-42ce-a029-2d1de0f48a75 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.726893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd1fe-923a-42ce-a029-2d1de0f48a75 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.727432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd1fe-923a-42ce-a029-2d1de0f48a75 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.729402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 463/931] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:37.734148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6210-d421-413d-a168-4db2e71db97a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.734648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6210-d421-413d-a168-4db2e71db97a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.735130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6210-d421-413d-a168-4db2e71db97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.755697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-7c4e6210-d421-413d-a168-4db2e71db97a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:37.761525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7c4e6210-d421-413d-a168-4db2e71db97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:37.787779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d7a9-eeb4-46fc-9edd-18bb6938bc41 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:37.822780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:37.824358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:37.824880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:37.825369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:37.826302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:37.827929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:37.828545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:37.851368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 464/932] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:37.857221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 469/933] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:37.870321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e6210-d421-413d-a168-4db2e71db97a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:37.994687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e6210-d421-413d-a168-4db2e71db97a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.039765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e32005-97bc-4ad5-b366-e3eff341739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.040982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32005-97bc-4ad5-b366-e3eff341739c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.041474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32005-97bc-4ad5-b366-e3eff341739c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.042564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32005-97bc-4ad5-b366-e3eff341739c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.053969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e32005-97bc-4ad5-b366-e3eff341739c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d4e32005-97bc-4ad5-b366-e3eff341739c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:38.063364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:38.064352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:38.065259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.065941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 465/934] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 23 13:34:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:38.072787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.081122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:38.096244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baa14-8e5f-489e-9322-ea7ed5eed0d3 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.096751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baa14-8e5f-489e-9322-ea7ed5eed0d3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.096848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baa14-8e5f-489e-9322-ea7ed5eed0d3 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.099396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 466/935] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:38.103940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ef9c-7626-4f9a-9c5f-0f9b8ac80494 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.104355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ef9c-7626-4f9a-9c5f-0f9b8ac80494 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.105152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ef9c-7626-4f9a-9c5f-0f9b8ac80494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.122872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-01c5ef9c-7626-4f9a-9c5f-0f9b8ac80494 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:38.124139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-01c5ef9c-7626-4f9a-9c5f-0f9b8ac80494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:38.176142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:38.179949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada15e4-6f8a-419e-8499-382d84b6509f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.207425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 467/936] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:38.215719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.216390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.216705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.216985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.217725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:38.218034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.219472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.227524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ef9c-7626-4f9a-9c5f-0f9b8ac80494 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.228428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 470/937] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:38.233680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.301964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:38.338662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379097-f48b-4c0c-b041-98c3579e302b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.341708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ef9c-7626-4f9a-9c5f-0f9b8ac80494 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.378503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.378949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.379358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.379746 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.379861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.380046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.380198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.380309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.381094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.382636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.384563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING keystone.server.flask.common [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 13:34:38.395187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.396885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.404240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.sql.core [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 13:34:38.404240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 13:34:38.404240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [parameters: {'id': '74164e82d21d4973a4e3d15dfafac1a6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 13:34:38.404240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86768) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 74164e82d21d4973a4e3d15dfafac1a6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 74164e82d21d4973a4e3d15dfafac1a6. Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:34:38.412836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result.read() Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 13:34:38.415346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application yield resource Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise self.value Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application session.commit() Jun 23 13:34:38.416474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.session.flush() Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application compat.raise_( Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 13:34:38.418084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 13:34:38.419278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application result.read() Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:34:38.420316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [parameters: {'id': '74164e82d21d4973a4e3d15dfafac1a6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.421387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:38.422359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 74164e82d21d4973a4e3d15dfafac1a6. Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.423513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 468/938] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Jun 23 13:34:38 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:38.426191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:38.427444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:38.428535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:38.428535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:38.428535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:38.428535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:38.434288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 471/939] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:38.436164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.466118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:38.564618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c68656-33e8-42f2-8bfa-8625a05b5ca4 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.569634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285fe38-c406-4c0f-bb18-483135e0753e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.594314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:38.605137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.606270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.606775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.607282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.614679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.614934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.615636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.615925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.616212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.616999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:38.617319 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.618026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.618692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.637212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 472/940] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:38.637398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:38.638227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:38.639114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:38.639592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.640895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 469/941] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:38.648266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.749962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:38.761720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b51d-c86e-43ff-ad04-dd0aa56bb572 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.778749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed733a-74db-4d15-89f2-b6eba6bcef9f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:38.797839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.798894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.799182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.799520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.800893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:38.801522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.803286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.823786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:38.824810 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:38.825256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:38.825694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:38.835319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 470/942] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:38.836710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:38.838396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:38.855232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:38.856459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:38.857431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:38.859778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 473/943] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:38.866011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:38.983509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a52c-bc16-4ce8-b8f4-60ead5c3d8e5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.021149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7c00-e1f2-4d9f-be66-31466c09b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.022112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7c00-e1f2-4d9f-be66-31466c09b190 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.022567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7c00-e1f2-4d9f-be66-31466c09b190 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.023007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7c00-e1f2-4d9f-be66-31466c09b190 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.024036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7c00-e1f2-4d9f-be66-31466c09b190 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:39.024514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7c00-e1f2-4d9f-be66-31466c09b190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.026227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7c00-e1f2-4d9f-be66-31466c09b190 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.044839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 471/944] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 23 13:34:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:39.050737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.096804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:39.143189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f611eb-c3ea-4fce-87e8-41a6104e9787 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.143714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f611eb-c3ea-4fce-87e8-41a6104e9787 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.143822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f611eb-c3ea-4fce-87e8-41a6104e9787 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.145447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 472/945] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:39.150724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ea847-328a-47b8-a346-33c6cafb2b8e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.151020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ea847-328a-47b8-a346-33c6cafb2b8e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.151377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ea847-328a-47b8-a346-33c6cafb2b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.168675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62488-0b1b-4225-a0f5-595dd0ef7e3c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.171532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-534ea847-328a-47b8-a346-33c6cafb2b8e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:39.173940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-534ea847-328a-47b8-a346-33c6cafb2b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:39.195585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:39.212878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.214481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.215074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.215605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.234128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.235634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:39.254152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:39.255092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:39.256717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:39.256717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:39.256717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:39.256717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:39.259338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 474/946] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:39.261449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.275248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 473/947] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:39.289766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ea847-328a-47b8-a346-33c6cafb2b8e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.380429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:39.392640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9906a4-42b9-42f6-9e16-a55f8e6d1ef5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.420693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ea847-328a-47b8-a346-33c6cafb2b8e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.433265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.434326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.434850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.435408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.436395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:39.436911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.438764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.451604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 475/948] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:39.459383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.467870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.468688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.468977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.469254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.469916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.471916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:39.489173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:39.490205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:39.491076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 474/949] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:39.499924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.506804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:39.584175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696361-276c-409d-ac72-56810abe70a2 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.629696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.630540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.630772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.631048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.640559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.642298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.644569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729685f-a274-4ff8-a7c6-158c88cea548 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:39.657280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:39.658248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:39.659198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:39.663198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 476/950] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:39.664460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.677979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:39.694323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.696046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.696702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.697332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.698534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:39.699465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.701317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.714249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 475/951] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:39.715710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.778282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b78c00-6a98-4b0e-9e41-5f92fe300aa5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.807182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:39.816360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.816360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.816650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.817018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.817884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:39.818262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.819829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.837598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 477/952] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:39.838968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.853291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e8f7c-308a-4125-9997-69c503349a88 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.890306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.891524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:39.892428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:39.892894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:39.894186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:39.894916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:39.896767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:39.908396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 476/953] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:39.909621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:39.928355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:39.962559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1892b0b-f27c-4ff9-b81c-7659a73be3e4 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:39.998736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2515-b421-4076-9745-0f5f4e38e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:39.999690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2515-b421-4076-9745-0f5f4e38e472 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:40.000012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2515-b421-4076-9745-0f5f4e38e472 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:40.000506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2515-b421-4076-9745-0f5f4e38e472 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/2fe7a2fd38f74ed6b5e2f3a1af29a3cc/roles/e8e71d6c1b3b4bfca8ce2509fc28017d` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:40.002883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d2515-b421-4076-9745-0f5f4e38e472 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc, role_id=e8e71d6c1b3b4bfca8ce2509fc28017d)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:40.004389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d2515-b421-4076-9745-0f5f4e38e472 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:40.027397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 478/954] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:39 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/2fe7a2fd38f74ed6b5e2f3a1af29a3cc/roles/e8e71d6c1b3b4bfca8ce2509fc28017d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:34:40.042997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606b432-02b5-4849-9534-c554c78e3281 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:40.060901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768443-21f7-44b0-983d-389b1e745dcd None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:40.061242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768443-21f7-44b0-983d-389b1e745dcd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:40.061512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9768443-21f7-44b0-983d-389b1e745dcd None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:40.063543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 479/955] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:40.068795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3306b-c4be-4a09-a786-8ea9607b402d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:40.069217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3306b-c4be-4a09-a786-8ea9607b402d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:40.069598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3306b-c4be-4a09-a786-8ea9607b402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:40.091621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:40.092465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-33f3306b-c4be-4a09-a786-8ea9607b402d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:40.093541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:40.094272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-33f3306b-c4be-4a09-a786-8ea9607b402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:40.094402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:40.094600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:40.094918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:40.095830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:40.098204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:40.139235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 477/956] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:34:40.196411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 480/957] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:40.221094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:40.333276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa26eb-11a7-4b2d-bdb1-7b9ef04d1349 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:40.369528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:40.370892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:40.371235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:40.371534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:40.372251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:40.373634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:40.386182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:40.387359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:40.388656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 478/958] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:40.393929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3306b-c4be-4a09-a786-8ea9607b402d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:40.452692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:40.502419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3306b-c4be-4a09-a786-8ea9607b402d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:40.538160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607db184-22a5-4d27-ba70-08db3e196247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:40.538842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607db184-22a5-4d27-ba70-08db3e196247 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:40.539130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607db184-22a5-4d27-ba70-08db3e196247 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:40.539445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607db184-22a5-4d27-ba70-08db3e196247 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:40.540164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607db184-22a5-4d27-ba70-08db3e196247 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:40.540478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607db184-22a5-4d27-ba70-08db3e196247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:40.542424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607db184-22a5-4d27-ba70-08db3e196247 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:40.547810 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 481/959] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:40.553472 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:40.606710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:40.660896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4cad6-8ce3-4e66-8bd6-c585a9a324c7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:40.695444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3aa91-3ec6-4458-8735-67218c36832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:40.696121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3aa91-3ec6-4458-8735-67218c36832d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:40.696404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3aa91-3ec6-4458-8735-67218c36832d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:40.696684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3aa91-3ec6-4458-8735-67218c36832d None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:40.697386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3aa91-3ec6-4458-8735-67218c36832d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:40.697693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3aa91-3ec6-4458-8735-67218c36832d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:40.699574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3aa91-3ec6-4458-8735-67218c36832d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:40.704781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 479/960] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:41.049630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915520f8-aa8c-4941-a263-cb7a289ccfbe None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:41.049839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915520f8-aa8c-4941-a263-cb7a289ccfbe None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:41.050102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915520f8-aa8c-4941-a263-cb7a289ccfbe None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:41.051722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 482/961] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:41.056964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66328-d1b6-4336-a035-151f53b2facc None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:41.057812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66328-d1b6-4336-a035-151f53b2facc None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:41.058074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66328-d1b6-4336-a035-151f53b2facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:41.075127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9cb66328-d1b6-4336-a035-151f53b2facc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:41.076340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9cb66328-d1b6-4336-a035-151f53b2facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:41.145707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 480/962] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:41.181505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915520f8-aa8c-4941-a263-cb7a289ccfbe None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:41.288163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915520f8-aa8c-4941-a263-cb7a289ccfbe None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:41.309504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:41.324285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:41.324961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:41.325247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:41.325527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:41.326299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:41.327816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:41.329112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING keystone.server.flask.common [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 13:34:41.342784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.sql.core [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 13:34:41.342784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 13:34:41.342784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [parameters: {'user_id': '1825e6cc1c9e4bdc9b5baf235b3faa6c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 13:34:41.342784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86769) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application result.read() Jun 23 13:34:41.360760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:34:41.361728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application yield resource Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application next(self.gen) Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise self.value Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application session.commit() Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 13:34:41.363167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self.session.flush() Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application compat.raise_( Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 13:34:41.364334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 13:34:41.365230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application conn.query(q) Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application result.read() Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 13:34:41.366077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [parameters: {'user_id': '1825e6cc1c9e4bdc9b5baf235b3faa6c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:41.367403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 13:34:41.370396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 13:34:41.379463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 13:34:41.379463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 13:34:41.379463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 13:34:41.379463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 13:34:41.379463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 13:34:41.379463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:41.379463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 483/963] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 23 13:34:41 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:41.380288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb66328-d1b6-4336-a035-151f53b2facc None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:41.424048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:41.488486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb66328-d1b6-4336-a035-151f53b2facc None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:41.538989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2850d-f2f9-4ca6-8887-20af90be19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:41.539820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2850d-f2f9-4ca6-8887-20af90be19fb None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:41.540110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2850d-f2f9-4ca6-8887-20af90be19fb None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:41.540388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2850d-f2f9-4ca6-8887-20af90be19fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:41.548128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2850d-f2f9-4ca6-8887-20af90be19fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:41.549560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2850d-f2f9-4ca6-8887-20af90be19fb None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-17a2850d-f2f9-4ca6-8887-20af90be19fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:41.564609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:41.566804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:41.569157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 481/964] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:41.572718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:41.674853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1e35-05af-44a0-ae59-2fd8f7114d71 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:41.708904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7aa397-1cf8-42ba-8395-3316e2b917a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:41.709586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aa397-1cf8-42ba-8395-3316e2b917a6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:41.709873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aa397-1cf8-42ba-8395-3316e2b917a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:41.710154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aa397-1cf8-42ba-8395-3316e2b917a6 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:41.710960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7aa397-1cf8-42ba-8395-3316e2b917a6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:41.711297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7aa397-1cf8-42ba-8395-3316e2b917a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:41.712939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7aa397-1cf8-42ba-8395-3316e2b917a6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:41.752153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 484/965] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 23 13:34:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:42.236662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb362a-92fe-4d5a-bf99-a44d96f28422 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.236983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb362a-92fe-4d5a-bf99-a44d96f28422 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.237393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb362a-92fe-4d5a-bf99-a44d96f28422 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.238909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 482/966] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:42.244078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b20b7-8265-480f-ab5f-c0a82540d52f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.244378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b20b7-8265-480f-ab5f-c0a82540d52f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.244660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b20b7-8265-480f-ab5f-c0a82540d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.262029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a30b20b7-8265-480f-ab5f-c0a82540d52f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:42.263637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a30b20b7-8265-480f-ab5f-c0a82540d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:42.298195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:42.311801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12062-3b69-4652-a2f5-6de9581d2c8d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.312094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12062-3b69-4652-a2f5-6de9581d2c8d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.312380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12062-3b69-4652-a2f5-6de9581d2c8d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.313750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 483/967] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:42.318817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3b7f3-528f-4abe-a91d-b9f672036d66 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.319220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3b7f3-528f-4abe-a91d-b9f672036d66 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.319422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3b7f3-528f-4abe-a91d-b9f672036d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.336884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-13a3b7f3-528f-4abe-a91d-b9f672036d66 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:42.338050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-13a3b7f3-528f-4abe-a91d-b9f672036d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:42.341146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 485/968] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:42.364515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b20b7-8265-480f-ab5f-c0a82540d52f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:42.410753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 484/969] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:42.434261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3b7f3-528f-4abe-a91d-b9f672036d66 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:42.473908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b20b7-8265-480f-ab5f-c0a82540d52f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:42.479290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:42.513919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:42.514767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.515241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.515470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.527065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:42.535785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:42.536825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:42.537697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 486/970] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 23 13:34:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:42.542967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:42.559237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3b7f3-528f-4abe-a91d-b9f672036d66 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:42.577004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:42.600850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:42.602368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.602944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.603493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.604480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:42.606600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:42.622280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:42.623487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:42.624522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:42.626948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 485/971] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:42.632300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:42.654420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851411b-b653-48a7-b8c3-d592892280fe None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:42.691423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:42.692094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.692381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.692662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.693405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:42.693717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:42.695094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:42.704055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 487/972] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 23 13:34:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:42.709433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:42.738584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:42.742924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12bb6-088d-48ea-be03-836b3133bdde None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:42.779969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:42.780549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.780837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.781119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.781819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:42.782120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:42.783851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:42.788574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 486/973] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:42.794196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:42.809931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:42.818920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdc5e-e750-49bc-bffb-a203aa67c85a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:42.852144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388a609-6512-48c8-8cec-64386857e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:42.852970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388a609-6512-48c8-8cec-64386857e6ca None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.853251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388a609-6512-48c8-8cec-64386857e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.853526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388a609-6512-48c8-8cec-64386857e6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.863797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388a609-6512-48c8-8cec-64386857e6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:42.865234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388a609-6512-48c8-8cec-64386857e6ca None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-8388a609-6512-48c8-8cec-64386857e6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:42.882084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:42.882979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:42.883926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:42.883926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:42.883926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:42.883926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:42.883926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 488/974] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:42.884903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077204-094b-47e7-9c73-db397201eccd None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.885184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077204-094b-47e7-9c73-db397201eccd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.886096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077204-094b-47e7-9c73-db397201eccd None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.887369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 489/975] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:42.889543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077204-094b-47e7-9c73-db397201eccd None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:42.897591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ac4de-21c5-4aed-9b19-32a85f525143 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:42.930457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afb80c-5cdd-479b-bd48-a6615028c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:42.931109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb80c-5cdd-479b-bd48-a6615028c546 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.931426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb80c-5cdd-479b-bd48-a6615028c546 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.931708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb80c-5cdd-479b-bd48-a6615028c546 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.932492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afb80c-5cdd-479b-bd48-a6615028c546 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:42.933292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afb80c-5cdd-479b-bd48-a6615028c546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:42.934647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afb80c-5cdd-479b-bd48-a6615028c546 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:42.940828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 487/976] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:42.941967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63f36-2172-4d02-a53d-2b41a651670a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:42.942253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63f36-2172-4d02-a53d-2b41a651670a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:42.942536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63f36-2172-4d02-a53d-2b41a651670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:42.957864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b2a63f36-2172-4d02-a53d-2b41a651670a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:42.959031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b2a63f36-2172-4d02-a53d-2b41a651670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:42.978395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:42.990617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077204-094b-47e7-9c73-db397201eccd None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.023359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.024016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.024137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 488/977] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:43.024324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.024580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:43.024838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a63f36-2172-4d02-a53d-2b41a651670a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:43.025374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:43.025687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:43.027161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:43.039107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 490/978] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:43.044875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:43.048417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:43.137455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a63f36-2172-4d02-a53d-2b41a651670a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.142711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48921-3cb6-4875-ba49-40a595c5c19e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.170795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.171474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.171768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.172044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:43.172839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] RBAC: Adding query filter params (interface=admin, service_id=5987b81b02764636aa27f97970341262, region_id=RegionOne) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:43.173153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:43.174514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:43.175714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.176524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.176817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.177099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:43.179579 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 489/979] 10.222.0.23 () {56 vars in 1249 bytes} [Thu Jun 23 13:34:43 2022] GET /identity/v3/endpoints?service_id=5987b81b02764636aa27f97970341262&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:43.180321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:43.184257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:43.185779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:43.201087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:43.202314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 491/980] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:34:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:43.203486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:43.208003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:43.264525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:43.285859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9a9b-5be4-4eac-87eb-cb94aa0e4794 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.302976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c7078-8cae-4ffd-a8d6-60062193a3a3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.319594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.320242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.320523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.320796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:43.321499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:43.322850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:43.335312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 490/981] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:43 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:43.336099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:43.346199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.346974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.347341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.347655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:43.348375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:43.349855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:43.358148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 492/982] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:43 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:34:43.446525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:43.476738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef73471-ec68-4c26-8e04-b22471436580 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.520028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.520706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.520994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.521270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:43.522142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:43.522567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:43.523915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:43.541666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 491/983] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 23 13:34:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:43.547907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:43.651128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af87f0-e0e3-4884-be29-4785c74d4074 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.674659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:43.687113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.687808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.688101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.688386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:43.756516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:43.757977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:43.863905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 493/984] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:43 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:34:43.865154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:43.964805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76764f9f-c107-4e57-a66f-ce001b27a89f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:43.997583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:43.998370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:43.998652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:43.998926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:44.005558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:44.011938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:44.013380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:44.031001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:44.031964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:44.037516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:44.037516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:44.037516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:44.037516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:44.037516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 492/985] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:44.039447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:44.064552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:44.145356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa7932-3c5c-473b-88d1-617f127f635e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:44.178304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:44.178960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:44.179265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:44.179544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:44.180253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:44.180560 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:44.181925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:44.193439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 494/986] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:44.199189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:44.297236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1516-79af-4724-a56b-c9f2dae14d22 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:44.330518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:44.331391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:44.331678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:44.331953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:44.338536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:44.340029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:44.353394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:44.354292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:44.355692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:44.361358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 493/987] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:44.361480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:44.448355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:44.468225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c53ef3-0c6f-452b-9997-6fa8cb8ff784 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:44.509445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8673438-5585-47f9-b189-15b097756bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:44.510106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673438-5585-47f9-b189-15b097756bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:44.510444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673438-5585-47f9-b189-15b097756bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:44.510725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673438-5585-47f9-b189-15b097756bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:44.511543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8673438-5585-47f9-b189-15b097756bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:44.511857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8673438-5585-47f9-b189-15b097756bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:44.513295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8673438-5585-47f9-b189-15b097756bb6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:44.530616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 495/988] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:44.532300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:44.584468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:44.635526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea72b-d714-477a-8643-4e444c0711d3 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:44.668386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdcaa0-72e4-4d03-a4c0-76c60384706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:44.669037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdcaa0-72e4-4d03-a4c0-76c60384706d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:44.669321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdcaa0-72e4-4d03-a4c0-76c60384706d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:44.669600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdcaa0-72e4-4d03-a4c0-76c60384706d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:44.670421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdcaa0-72e4-4d03-a4c0-76c60384706d None admin] RBAC: Adding query filter params (role.id=e8e71d6c1b3b4bfca8ce2509fc28017d, scope.project.id=8aae95f970644f279053e3f140353481, user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:44.670736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdcaa0-72e4-4d03-a4c0-76c60384706d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:44.672190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdcaa0-72e4-4d03-a4c0-76c60384706d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:44.678097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 494/989] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:44 2022] GET /identity/v3/role_assignments?user.id=2fe7a2fd38f74ed6b5e2f3a1af29a3cc&scope.project.id=8aae95f970644f279053e3f140353481&role.id=e8e71d6c1b3b4bfca8ce2509fc28017d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:45.398168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade01d-ed1c-4964-9d6f-e7d0038f4743 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.398698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade01d-ed1c-4964-9d6f-e7d0038f4743 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.398821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade01d-ed1c-4964-9d6f-e7d0038f4743 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.400379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 496/990] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:45.406310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4681e05-eea4-4ab8-88f0-77a92e32eb0d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.406609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4681e05-eea4-4ab8-88f0-77a92e32eb0d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.406892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4681e05-eea4-4ab8-88f0-77a92e32eb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.418248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28e0e-2d8d-4604-b9ae-8a9ba2a2aae8 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.418539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28e0e-2d8d-4604-b9ae-8a9ba2a2aae8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.418823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28e0e-2d8d-4604-b9ae-8a9ba2a2aae8 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.420345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 497/991] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:45.424979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf386f-9425-4d88-acdc-f6ea10587090 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.425194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e4681e05-eea4-4ab8-88f0-77a92e32eb0d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:45.425293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf386f-9425-4d88-acdc-f6ea10587090 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.425548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf386f-9425-4d88-acdc-f6ea10587090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.426384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e4681e05-eea4-4ab8-88f0-77a92e32eb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:45.441517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0caf386f-9425-4d88-acdc-f6ea10587090 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:45.442698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0caf386f-9425-4d88-acdc-f6ea10587090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:45.502446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 495/992] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:45.518005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 498/993] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:45.525822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4681e05-eea4-4ab8-88f0-77a92e32eb0d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:45.540101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf386f-9425-4d88-acdc-f6ea10587090 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:45.575990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:45.619256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:45.640436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4681e05-eea4-4ab8-88f0-77a92e32eb0d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:45.646272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf386f-9425-4d88-acdc-f6ea10587090 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:45.677238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:45.677960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.678250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.678528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.679180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:45.680436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:45.680558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:45.681420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.681709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.681991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.683310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:45.684795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:45.692626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:45.693594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:45.694447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 496/994] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:45.700827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:45.702166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:45.707779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:45.708648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 499/995] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 23 13:34:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:45.709459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:45.805217 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e5888-3aa8-41c6-812b-54cfff215767 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:45.814456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:45.818681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5d5b4-ad73-4032-a670-774bbae09bec None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:45.843809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:45.844565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.844850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.845128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.845841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:45.846149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:45.847569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:45.852727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 497/996] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:45.856048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:45.856891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.857591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.858050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:45.858217 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:45.859066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:45.859561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:45.861298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:45.867955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 500/997] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:45.874573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:45.878085 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:45.962123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5912d0-953b-484d-8329-389e1cee7db8 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:45.975245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a2b28-593e-498b-8ae5-d86790253548 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:45.997922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:45.998808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:45.999283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:45.999721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:46.000572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:46.001049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:46.002574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:46.007810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 498/998] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:46.013457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:46.014860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:46.015549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:46.015836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:46.016114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:46.017069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:46.017378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:46.018740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:46.028120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 501/999] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 23 13:34:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:46.029505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:46.056231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:46.096263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:46.127555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432e80-409d-419a-b5dc-bb827c52ec28 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:46.134019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34befe-7794-47c8-96ff-9d338eb79350 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:46.162968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:46.163644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:46.163931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:46.164208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:46.164988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] RBAC: Adding query filter params (interface=public, service_id=eb1660c3490a46618c37117cdc4bb538, region_id=RegionOne) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:46.165300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:46.166682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:46.170223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e009e41-f9d3-4853-ae1b-d047df2d1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:46.170878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e009e41-f9d3-4853-ae1b-d047df2d1b5f None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:46.171320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e009e41-f9d3-4853-ae1b-d047df2d1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:46.171646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e009e41-f9d3-4853-ae1b-d047df2d1b5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:46.172113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 499/1000] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:34:46 2022] GET /identity/v3/endpoints?service_id=eb1660c3490a46618c37117cdc4bb538&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:46.176357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e009e41-f9d3-4853-ae1b-d047df2d1b5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:46.177144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e009e41-f9d3-4853-ae1b-d047df2d1b5f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:46.177801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:46.194099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 502/1001] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:34:46.295184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:46.299135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f048-e9f2-473e-a2cd-ac53e543cc88 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:46.342886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c5b3-244c-45fa-8fb1-333da65fb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:46.343588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c5b3-244c-45fa-8fb1-333da65fb630 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:46.343880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c5b3-244c-45fa-8fb1-333da65fb630 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:46.344161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c5b3-244c-45fa-8fb1-333da65fb630 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:46.344844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c5b3-244c-45fa-8fb1-333da65fb630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:46.346207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c5b3-244c-45fa-8fb1-333da65fb630 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:46.352640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 500/1002] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:46 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:34:46.777907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca9b96-db6c-4dd9-908a-24c799aecabc None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:46.778427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca9b96-db6c-4dd9-908a-24c799aecabc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:46.778505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca9b96-db6c-4dd9-908a-24c799aecabc None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:46.779905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 503/1003] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:46.785068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3135-1b8d-42f7-8d60-20b36c892b65 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:46.785460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3135-1b8d-42f7-8d60-20b36c892b65 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:46.785642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3135-1b8d-42f7-8d60-20b36c892b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:46.802719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f7ee3135-1b8d-42f7-8d60-20b36c892b65 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:46.803937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f7ee3135-1b8d-42f7-8d60-20b36c892b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:46.873885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 501/1004] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:46.896657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca9b96-db6c-4dd9-908a-24c799aecabc None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:47.001152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca9b96-db6c-4dd9-908a-24c799aecabc None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:47.025751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:47.037300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:47.038035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:47.038322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:47.038603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:47.039278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:47.040660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:47.052786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:47.053863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:47.054716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:47.056298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 504/1005] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jun 23 13:34:46 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:47.059882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3135-1b8d-42f7-8d60-20b36c892b65 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:47.148752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:47.160129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3135-1b8d-42f7-8d60-20b36c892b65 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:47.193472 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2735-445e-45ac-a959-0f28c40bec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:47.194132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2735-445e-45ac-a959-0f28c40bec88 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:47.194419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2735-445e-45ac-a959-0f28c40bec88 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:47.194699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2735-445e-45ac-a959-0f28c40bec88 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:47.195432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2735-445e-45ac-a959-0f28c40bec88 None admin] RBAC: Adding query filter params (name=image) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:47.195744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2735-445e-45ac-a959-0f28c40bec88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:47.197105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2735-445e-45ac-a959-0f28c40bec88 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:47.202192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 502/1006] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:47.207523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:47.307766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7eb0e-9401-430b-8cfb-566ac57785a8 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:47.342921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be473d6-6f27-48cf-829d-cbc0417713ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:47.343624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be473d6-6f27-48cf-829d-cbc0417713ac None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:47.343908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be473d6-6f27-48cf-829d-cbc0417713ac None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:47.344187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be473d6-6f27-48cf-829d-cbc0417713ac None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:47.344895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be473d6-6f27-48cf-829d-cbc0417713ac None admin] RBAC: Adding query filter params (type=image) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:47.345204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be473d6-6f27-48cf-829d-cbc0417713ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:47.346589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be473d6-6f27-48cf-829d-cbc0417713ac None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:47.359317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 505/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:48.244736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890467-b7d2-4c0f-92fe-153360fc9e59 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.245748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890467-b7d2-4c0f-92fe-153360fc9e59 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.245827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890467-b7d2-4c0f-92fe-153360fc9e59 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.247316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 503/1008] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:48.252341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a703-9e11-41a1-95e0-a65d5ca4534c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.252766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a703-9e11-41a1-95e0-a65d5ca4534c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.252931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a703-9e11-41a1-95e0-a65d5ca4534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.269597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7224a703-9e11-41a1-95e0-a65d5ca4534c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:48.270764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7224a703-9e11-41a1-95e0-a65d5ca4534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:48.320158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:48.338801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 506/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:48.362087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890467-b7d2-4c0f-92fe-153360fc9e59 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:48.405824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7806-8269-4c94-af13-225f25bf13c9 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.406115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7806-8269-4c94-af13-225f25bf13c9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.406402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7806-8269-4c94-af13-225f25bf13c9 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.407827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 507/1010] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:48.413068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4d047-6347-4ebe-8af2-3d00472d071e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.413355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4d047-6347-4ebe-8af2-3d00472d071e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.413631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4d047-6347-4ebe-8af2-3d00472d071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.431591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-68e4d047-6347-4ebe-8af2-3d00472d071e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:48.433316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-68e4d047-6347-4ebe-8af2-3d00472d071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:48.474458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890467-b7d2-4c0f-92fe-153360fc9e59 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:48.506754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 508/1011] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:48.514184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:48.514975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.515283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.515561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.517027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:48.518498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:48.524881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 504/1012] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:48.526401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4d047-6347-4ebe-8af2-3d00472d071e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:48.531548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:48.556919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:48.631522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4d047-6347-4ebe-8af2-3d00472d071e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:48.631880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646771-1f58-4f7e-b071-b06399b594be None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:48.646170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:48.668855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:48.669695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.670124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.670557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.671436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:48.671670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:48.672456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.672740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.673016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.673664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:48.673812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:48.675004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:48.686662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:48.687900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:48.688749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 505/1013] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:48.693534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:48.705603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 509/1014] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:48 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:48.799092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:48.816687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785df5a-e5d4-4857-b0b4-256f93e1c220 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:48.854448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:48.854448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:48.854744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:48.854997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:48.855607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:48.855922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:48.857294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:48.863175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 506/1015] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:48.869045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:48.973589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e6db-f755-4cc2-949c-084e042b420a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:49.009117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01888e-37f8-4ac2-8a6b-1082f811d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:49.009787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01888e-37f8-4ac2-8a6b-1082f811d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:49.010074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01888e-37f8-4ac2-8a6b-1082f811d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:49.010408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01888e-37f8-4ac2-8a6b-1082f811d6a3 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:49.011117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01888e-37f8-4ac2-8a6b-1082f811d6a3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:49.011456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01888e-37f8-4ac2-8a6b-1082f811d6a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:49.012832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01888e-37f8-4ac2-8a6b-1082f811d6a3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:49.018318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 510/1016] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 23 13:34:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:49.024137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:49.127171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3111e0d-0c53-422a-a529-faa4368bb433 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:49.161536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912a79-3459-4097-82cf-8269e47277f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:49.162204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912a79-3459-4097-82cf-8269e47277f9 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:49.162491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912a79-3459-4097-82cf-8269e47277f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:49.162772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912a79-3459-4097-82cf-8269e47277f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:49.163545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912a79-3459-4097-82cf-8269e47277f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:49.164912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912a79-3459-4097-82cf-8269e47277f9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:49.186362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 507/1017] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:49.377042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a678979-e104-44a5-be2f-2e3253370a5a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:49.377616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a678979-e104-44a5-be2f-2e3253370a5a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:49.377616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a678979-e104-44a5-be2f-2e3253370a5a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:49.379231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 511/1018] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:49.384363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21256-4608-4d9d-b6cc-573d85dbd553 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:49.384768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21256-4608-4d9d-b6cc-573d85dbd553 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:49.384939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21256-4608-4d9d-b6cc-573d85dbd553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:49.398577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:49.405275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-c8e21256-4608-4d9d-b6cc-573d85dbd553 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:49.406855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c8e21256-4608-4d9d-b6cc-573d85dbd553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:49.493493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 508/1019] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:49.517416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a678979-e104-44a5-be2f-2e3253370a5a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:49.548634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:49.621604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a678979-e104-44a5-be2f-2e3253370a5a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:49.655052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890b8be-80e6-4eec-9767-ca32d967ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:49.655671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890b8be-80e6-4eec-9767-ca32d967ce91 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:49.655960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890b8be-80e6-4eec-9767-ca32d967ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:49.656241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890b8be-80e6-4eec-9767-ca32d967ce91 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:49.656968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890b8be-80e6-4eec-9767-ca32d967ce91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:49.658340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890b8be-80e6-4eec-9767-ca32d967ce91 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:49.679230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 512/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:34:49 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:50.793989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b0586-5635-42f3-9217-b7c35cb7bb09 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:50.794482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b0586-5635-42f3-9217-b7c35cb7bb09 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:50.794482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b0586-5635-42f3-9217-b7c35cb7bb09 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:50.795902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 509/1021] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:50.801133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27fcc7-e336-496e-95e2-0cea7c8bea6d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:50.801513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27fcc7-e336-496e-95e2-0cea7c8bea6d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:50.801698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27fcc7-e336-496e-95e2-0cea7c8bea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:50.818868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5d27fcc7-e336-496e-95e2-0cea7c8bea6d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:50.820305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d27fcc7-e336-496e-95e2-0cea7c8bea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:50.893579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 513/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:50.919104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b0586-5635-42f3-9217-b7c35cb7bb09 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:51.020507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b0586-5635-42f3-9217-b7c35cb7bb09 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:51.050282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:51.056268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111850-66b8-4b60-a521-d532ef61c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:51.057089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111850-66b8-4b60-a521-d532ef61c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.057379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111850-66b8-4b60-a521-d532ef61c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.057659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111850-66b8-4b60-a521-d532ef61c6a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.058821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111850-66b8-4b60-a521-d532ef61c6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:51.060281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111850-66b8-4b60-a521-d532ef61c6a3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:51.062049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 510/1023] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:51.067587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27fcc7-e336-496e-95e2-0cea7c8bea6d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:51.085005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:51.169743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27fcc7-e336-496e-95e2-0cea7c8bea6d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:51.203603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a84f3c-0dd1-486d-9d2e-0000852dc1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:51.204270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84f3c-0dd1-486d-9d2e-0000852dc1d7 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.204554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84f3c-0dd1-486d-9d2e-0000852dc1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.204830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84f3c-0dd1-486d-9d2e-0000852dc1d7 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.205539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a84f3c-0dd1-486d-9d2e-0000852dc1d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:51.206967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a84f3c-0dd1-486d-9d2e-0000852dc1d7 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:51.229052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 514/1024] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:34:51 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:34:51.324461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd248-82dd-4a37-a06e-3baa5654a64b None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.324745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd248-82dd-4a37-a06e-3baa5654a64b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.325232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd248-82dd-4a37-a06e-3baa5654a64b None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.326775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 511/1025] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:51.332333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca098-01e8-470d-97e7-bd5fac8a6998 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.332633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca098-01e8-470d-97e7-bd5fac8a6998 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.332938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca098-01e8-470d-97e7-bd5fac8a6998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.352134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-512ca098-01e8-470d-97e7-bd5fac8a6998 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:51.353393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-512ca098-01e8-470d-97e7-bd5fac8a6998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:51.427272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 515/1026] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:51.451001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd248-82dd-4a37-a06e-3baa5654a64b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:51.561904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd248-82dd-4a37-a06e-3baa5654a64b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:51.596334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bddad1-a907-4b39-a494-8c8c0f1beb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:51.597064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bddad1-a907-4b39-a494-8c8c0f1beb10 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.597346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bddad1-a907-4b39-a494-8c8c0f1beb10 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.597621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bddad1-a907-4b39-a494-8c8c0f1beb10 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.608634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bddad1-a907-4b39-a494-8c8c0f1beb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-14bddad1-a907-4b39-a494-8c8c0f1beb10 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:51.616785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:51.617721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:51.618591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 512/1027] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 23 13:34:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:51.625244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca098-01e8-470d-97e7-bd5fac8a6998 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:51.627424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:51.719054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50469de1-4a74-4081-9567-faa123a3fb7b None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.719382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50469de1-4a74-4081-9567-faa123a3fb7b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.719672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50469de1-4a74-4081-9567-faa123a3fb7b None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.721058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 513/1028] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:51.725988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f64ce-bf8c-4f67-9b53-651accf06673 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.726285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f64ce-bf8c-4f67-9b53-651accf06673 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.726569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f64ce-bf8c-4f67-9b53-651accf06673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.730614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca098-01e8-470d-97e7-bd5fac8a6998 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:51.743884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-689f64ce-bf8c-4f67-9b53-651accf06673 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:51.745187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-689f64ce-bf8c-4f67-9b53-651accf06673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:51.766780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:51.767897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.768186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.768625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.769369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:51.769676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:51.771047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:51.780283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 516/1029] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 23 13:34:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:51.785724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:51.809753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:51.822484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 514/1030] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:51.845570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f64ce-bf8c-4f67-9b53-651accf06673 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:51.856862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:51.900229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61c546-2de1-410b-ac31-ed5d5cc1bf25 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:51.937791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:51.938599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.938889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.939183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.949270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f64ce-bf8c-4f67-9b53-651accf06673 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:51.950231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:51.952109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:51.969152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:51.970072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:51.970984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:51.970984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:51.970984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:51.970984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:51.970984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 517/1031] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:51.976312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:51.986326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:51.987117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:51.987427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:51.987707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:51.988355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:51.989831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:52.002375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:52.007433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:52.008519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 515/1032] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jun 23 13:34:51 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:52.010416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.071130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:52.091826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7fba3-11bb-4298-97e2-dcdb8232a955 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.108836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:52.121061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572b01-89f3-4f73-b64e-cb41bfa0f6b6 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.127566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.128235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.128524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.128804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.129524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:52.129840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.131222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.143762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 518/1033] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:52.149280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.158022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.158920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.159033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.159265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.159964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:52.160276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.161634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.166735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 516/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:52.171822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.261981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19ab07-795a-42b0-b855-f90b5460d482 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.277138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333b61-eb3c-4940-bea6-57f74eed30a7 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.294950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:52.297825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.298645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.298930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.299233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.306287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.308266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.314433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.315333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.315813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.316296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.317170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] RBAC: Adding query filter params (type=image) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:52.317653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.319173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:52.324328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:52.325285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:52.326806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 519/1035] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:52.331067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 517/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:52.331176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.331798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.370381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:52.442830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c5d6a-c685-45d3-8436-8627dbff25ea None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.445326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab0f2-c856-4241-ac2f-6b42d531c568 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.487559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.487936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.488238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.488527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.488656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.488881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.489002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.489154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.489603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] RBAC: Adding query filter params (interface=public, service_id=833320ba83f14503b15585a877af0c93, region_id=RegionOne) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:52.489923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.490018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:52.490288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.491333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.491756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.501738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 518/1037] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/endpoints?service_id=833320ba83f14503b15585a877af0c93&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:52.503560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.512006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 520/1038] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:52.517426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.554031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:52.612118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ccb08-1ad3-4a3c-9896-79cadc3d640e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.620613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:52.628473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a169b-0944-44e9-b8df-6e0d3a45b480 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.650538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.651836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.652124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.652404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.653079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.654449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.661219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 519/1039] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:34:52.677199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:52.677984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:52.678344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:52.678690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:52.753221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:52.755339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:52.856121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:52.869341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 521/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:34:52.871484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:52.973130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c89b4-4e95-4b04-a9d3-490a9632d91f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:52.984095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:53.009837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.010630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.010916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.011196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.022463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:53.023939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:53.042340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:53.043327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:53.044243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:53.044243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:53.044243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:53.044243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:53.049191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:53.051307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 520/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:53.150578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70730bb9-e7c0-42e6-900b-588de3c8dd53 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:53.185052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25383ea8-5a28-44e7-846f-6255f4047570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.185716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25383ea8-5a28-44e7-846f-6255f4047570 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.186002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25383ea8-5a28-44e7-846f-6255f4047570 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.186282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25383ea8-5a28-44e7-846f-6255f4047570 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.187000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25383ea8-5a28-44e7-846f-6255f4047570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:53.187340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25383ea8-5a28-44e7-846f-6255f4047570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:53.188718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25383ea8-5a28-44e7-846f-6255f4047570 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:53.200236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 522/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:53.205520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:53.309041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1983939-16cd-4657-96ab-42d6cd2bb4e8 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:53.342481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.343293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.343583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.343866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.350781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:53.352229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:53.355886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e42c9-297a-46f8-a5e3-f25736b40d31 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.356180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e42c9-297a-46f8-a5e3-f25736b40d31 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.356463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e42c9-297a-46f8-a5e3-f25736b40d31 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.357961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 523/1043] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:53.362553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183936-5907-46d5-80ba-7894deb4ceb8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.362844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183936-5907-46d5-80ba-7894deb4ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.363122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40183936-5907-46d5-80ba-7894deb4ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:53.367589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:53.368468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:53.369393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:53.375286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 521/1044] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:53.376324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:53.380575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-40183936-5907-46d5-80ba-7894deb4ceb8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:53.381759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-40183936-5907-46d5-80ba-7894deb4ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:53.401636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:53.435383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:53.454474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 524/1045] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:53.479831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183936-5907-46d5-80ba-7894deb4ceb8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:53.488047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff4d87-ee76-49a8-a097-54965446f33d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:53.523346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.524011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.524295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.524576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.525361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:53.525672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:53.527732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:53.539564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 522/1046] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:53.545210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:53.590004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40183936-5907-46d5-80ba-7894deb4ceb8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:53.625528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.626320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.626609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.626888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.628841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:53.638182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:53.646035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:53.646960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:53.648474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 525/1047] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:53.653465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:53.655152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2f62d-53ff-472b-bd74-1cf177cffefc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:53.689601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.690497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.690780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.691164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.692064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] RBAC: Adding query filter params (role.id=e8e71d6c1b3b4bfca8ce2509fc28017d, scope.project.id=8aae95f970644f279053e3f140353481, user.id=c37e7d70e2864edaa125e8f5ac1a3373) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:53.692377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:53.693803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:53.700396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:53.711617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 523/1048] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/role_assignments?user.id=c37e7d70e2864edaa125e8f5ac1a3373&scope.project.id=8aae95f970644f279053e3f140353481&role.id=e8e71d6c1b3b4bfca8ce2509fc28017d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:53.766769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a108324-38b5-4733-bc96-644c419dbd2d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:53.808641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.809333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.809624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.809908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.810674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:53.810988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:53.812466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:53.827724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 526/1049] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:53.829388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:53.930646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb979fba-d732-4815-b6ce-c8db661bcbb1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:53.964896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:53.965763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:53.966044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:53.966319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] PATH_INFO: `/v3/users/92483f324e2847d6b1ace6759fd7d9e7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:53.979562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] RBAC: Authorizing `identity:get_user(user_id=92483f324e2847d6b1ace6759fd7d9e7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:53.980986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:53.982846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 524/1050] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/users/92483f324e2847d6b1ace6759fd7d9e7 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:53.988268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:54.087129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5f00b-72e8-4c79-aab4-a9bbe3578bbe None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:54.093953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:54.121110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:54.121761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:54.122045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:54.122324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:54.189886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:54.191280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:54.289270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 527/1051] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:34:54.295278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:54.299023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:54.399354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03714f79-b3fd-47b0-98b4-9893737c24d1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:54.433519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739ad78-8a88-44d4-979f-7add08f1d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:54.434368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739ad78-8a88-44d4-979f-7add08f1d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:54.434653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739ad78-8a88-44d4-979f-7add08f1d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:54.434931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739ad78-8a88-44d4-979f-7add08f1d2a1 None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:54.436114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739ad78-8a88-44d4-979f-7add08f1d2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=7baba05d0aad4d57b649b3426486c082)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:54.437529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739ad78-8a88-44d4-979f-7add08f1d2a1 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:54.439480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 525/1052] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:34:54 2022] GET /identity/v3/projects/7baba05d0aad4d57b649b3426486c082 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:54.445231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:54.453721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:54.553462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3b939-1776-4c7c-87bf-6b1c7a9ebc25 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:54.587379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233158-be93-47d5-bf41-e75b0c49bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:54.588032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233158-be93-47d5-bf41-e75b0c49bca8 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:54.588340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233158-be93-47d5-bf41-e75b0c49bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:54.588618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233158-be93-47d5-bf41-e75b0c49bca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:54.589441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233158-be93-47d5-bf41-e75b0c49bca8 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=7baba05d0aad4d57b649b3426486c082, user.id=92483f324e2847d6b1ace6759fd7d9e7) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:54.589753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233158-be93-47d5-bf41-e75b0c49bca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:54.591177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233158-be93-47d5-bf41-e75b0c49bca8 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:54.603410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 528/1053] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:34:54 2022] GET /identity/v3/role_assignments?user.id=92483f324e2847d6b1ace6759fd7d9e7&scope.project.id=7baba05d0aad4d57b649b3426486c082&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:54.713695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9033-aad9-43be-a484-8c9cabde57d8 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:54.713902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9033-aad9-43be-a484-8c9cabde57d8 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:54.714180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9033-aad9-43be-a484-8c9cabde57d8 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:54.715609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 526/1054] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:54.721167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33d0fd-355c-4f87-921a-7d1dd47df1d3 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:54.721473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33d0fd-355c-4f87-921a-7d1dd47df1d3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:54.721764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33d0fd-355c-4f87-921a-7d1dd47df1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:54.739940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1c33d0fd-355c-4f87-921a-7d1dd47df1d3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:54.741026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1c33d0fd-355c-4f87-921a-7d1dd47df1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:54.805792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:54.811617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 529/1055] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:54.834554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9033-aad9-43be-a484-8c9cabde57d8 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:54.907978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:54.940191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9033-aad9-43be-a484-8c9cabde57d8 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:54.973465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:54.974170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:54.974452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:54.974722 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] PATH_INFO: `/v3/services/image` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:54.975391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:54.976742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:54.988540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:54.989546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:54.990928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 527/1056] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jun 23 13:34:54 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:54.996161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33d0fd-355c-4f87-921a-7d1dd47df1d3 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:55.097919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33d0fd-355c-4f87-921a-7d1dd47df1d3 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:55.132588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:55.133262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:55.133553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:55.133836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:55.134543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:55.134855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:55.136305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:55.146143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 530/1057] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:55.147667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:55.251690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fbbac-73f2-4d80-abb8-d80fe2fdf5ad None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:55.285998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd617d4-0d93-45ed-aa4f-294e0cf7899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:55.286665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd617d4-0d93-45ed-aa4f-294e0cf7899d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:55.286955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd617d4-0d93-45ed-aa4f-294e0cf7899d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:55.287260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd617d4-0d93-45ed-aa4f-294e0cf7899d None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:55.287974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd617d4-0d93-45ed-aa4f-294e0cf7899d None admin] RBAC: Adding query filter params (type=image) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:55.288285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd617d4-0d93-45ed-aa4f-294e0cf7899d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:55.289661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd617d4-0d93-45ed-aa4f-294e0cf7899d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:55.292283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:55.296306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 528/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:55.301930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:55.366062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:55.404812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fca98-85f5-48dc-ab98-971f8dd675a0 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:55.439288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010acf6-e09a-4c42-81a2-5f374a6202ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:55.439989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010acf6-e09a-4c42-81a2-5f374a6202ea None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:55.440283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010acf6-e09a-4c42-81a2-5f374a6202ea None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:55.440565 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010acf6-e09a-4c42-81a2-5f374a6202ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:55.441314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010acf6-e09a-4c42-81a2-5f374a6202ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:55.442690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010acf6-e09a-4c42-81a2-5f374a6202ea None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:55.471250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 531/1059] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:34:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:34:55.851798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79a6e-975d-40e5-819b-63a5e7066ffb None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:55.852182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79a6e-975d-40e5-819b-63a5e7066ffb None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:55.852383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79a6e-975d-40e5-819b-63a5e7066ffb None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:55.853869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 529/1060] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:55.858780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24371-246d-4451-bc53-1c3a65a3a5a7 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:55.859081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24371-246d-4451-bc53-1c3a65a3a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:55.859405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24371-246d-4451-bc53-1c3a65a3a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:55.875806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-edd24371-246d-4451-bc53-1c3a65a3a5a7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:55.877002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-edd24371-246d-4451-bc53-1c3a65a3a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:55.954245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 532/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:55.977341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79a6e-975d-40e5-819b-63a5e7066ffb None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.079373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79a6e-975d-40e5-819b-63a5e7066ffb None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:56.112152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:56.112895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.113182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.113463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.124755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:56.132773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:56.133717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:34:56.134601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:56.139312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 530/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 23 13:34:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:56.140859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24371-246d-4451-bc53-1c3a65a3a5a7 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.187868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:56.250245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24371-246d-4451-bc53-1c3a65a3a5a7 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:56.284316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:56.284995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.285278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.285561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.286314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:56.286627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:56.288043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:56.300695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 533/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 23 13:34:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:56.301829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.361024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:56.403891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121e9eb-f42f-4794-b662-09ce1b2be828 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:56.438021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeb34e-7cd7-40ae-8d3d-8a0e420c8ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:56.438809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb34e-7cd7-40ae-8d3d-8a0e420c8ea3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.439098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb34e-7cd7-40ae-8d3d-8a0e420c8ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.439518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb34e-7cd7-40ae-8d3d-8a0e420c8ea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.449897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeb34e-7cd7-40ae-8d3d-8a0e420c8ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:56.451397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeb34e-7cd7-40ae-8d3d-8a0e420c8ea3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-9dbeb34e-7cd7-40ae-8d3d-8a0e420c8ea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:56.471383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:56.472353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:56.473272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:56.473272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:56.473272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:56.473272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:56.475403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 531/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:56.478388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.588110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f37ef-9a28-4c71-884d-040fc30cfe1b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:56.597645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:56.600796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390996de-b553-4743-b76f-c703288c2b21 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.601224 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390996de-b553-4743-b76f-c703288c2b21 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.601578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390996de-b553-4743-b76f-c703288c2b21 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.603409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 532/1065] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:56.609577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c865d-39d6-4acc-8782-c62dac32a897 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.609890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c865d-39d6-4acc-8782-c62dac32a897 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.610148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c865d-39d6-4acc-8782-c62dac32a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.627314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:56.627976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.628083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-223c865d-39d6-4acc-8782-c62dac32a897 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:56.628260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.628533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.629171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-223c865d-39d6-4acc-8782-c62dac32a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:56.629270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:56.629540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:56.630908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:56.644488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 534/1066] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:56.649726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.703320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 533/1067] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:56.722881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c865d-39d6-4acc-8782-c62dac32a897 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.759713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc915f31-656e-4852-a35c-401a37878980 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:56.770364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:56.798764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:56.799585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.799873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.800229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.811334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:56.813614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:34:56.829136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:56.830924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:34:56.832317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:56.835043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 535/1068] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:34:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:56.835771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.840456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c865d-39d6-4acc-8782-c62dac32a897 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:56.866429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:56.875821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:56.876620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.876913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.877199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.888042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:56.895866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:56.896821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:56.897725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 534/1069] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:56.903225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:56.948742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c03e-cd9a-4e7c-a7a5-5f494627ca77 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:56.985598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:56.986303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:56.986620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:56.986987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:56.987864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:56.988180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:56.989733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.004944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeee6a-f180-48d4-b004-3408e9cf337e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.006501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.015349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 536/1070] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:34:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:57.016879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.043822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.044542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.044833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.045120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.045912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:57.046228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.048281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.056280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 535/1071] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:57.062299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.107703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.125553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da576b-adc1-4784-a8a9-58367330db5b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.168130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.169354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.169937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.170213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.175758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54bc26-1041-44be-8e69-239bb5495381 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.185582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.187621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:57.210356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:57.211310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:57.212229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:57.212229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:57.212229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:57.212229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:34:57.213029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 537/1072] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:34:57.213633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.214514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.214957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.215352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] PATH_INFO: `/v3/users/92483f324e2847d6b1ace6759fd7d9e7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.216646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] RBAC: Authorizing `identity:get_user(user_id=92483f324e2847d6b1ace6759fd7d9e7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.218144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.218361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.224934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 536/1073] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:34:57 2022] GET /identity/v3/users/92483f324e2847d6b1ace6759fd7d9e7 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:57.225732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.259065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.320597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2542-0ac3-470d-be7d-8811e44eaf0c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.334953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6559f6-e612-456c-98fd-631aa2d4d394 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.358496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.359482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.359778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.360059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.360787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:57.361099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.362498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.369168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.372030 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.373394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.373832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.374261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.380038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=7baba05d0aad4d57b649b3426486c082)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.381469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.387920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 537/1074] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:34:57 2022] GET /identity/v3/projects/7baba05d0aad4d57b649b3426486c082 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:57.388071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 538/1075] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:34:57.388168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.389489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.499822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.503505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4f0de-a5f7-4fcd-a248-4ddf87efa5a0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.504579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ce13f-43fe-4905-8de4-774edef6a636 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.540159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda25b51-9e41-49c9-8d60-ca6936982daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.540344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.540897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.541004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25b51-9e41-49c9-8d60-ca6936982daf None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.541178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.541316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25b51-9e41-49c9-8d60-ca6936982daf None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.542084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.542186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25b51-9e41-49c9-8d60-ca6936982daf None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082/users/92483f324e2847d6b1ace6759fd7d9e7/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.544087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda25b51-9e41-49c9-8d60-ca6936982daf None admin] RBAC: Authorizing `identity:create_grant(project_id=7baba05d0aad4d57b649b3426486c082, user_id=92483f324e2847d6b1ace6759fd7d9e7, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.545521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda25b51-9e41-49c9-8d60-ca6936982daf None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.549728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.551156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.558257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 539/1076] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:57 2022] PUT /identity/v3/projects/7baba05d0aad4d57b649b3426486c082/users/92483f324e2847d6b1ace6759fd7d9e7/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:34:57.559531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74924f-3394-4cc5-be3d-bf5ce8376eca None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.559824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74924f-3394-4cc5-be3d-bf5ce8376eca None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.560109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74924f-3394-4cc5-be3d-bf5ce8376eca None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.563251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 540/1077] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:34:57.566339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:57.567403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:34:57.568351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:57.568778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9bd0-2e08-4bbb-90a2-bc7532035072 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.568860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 538/1078] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:57.568937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9bd0-2e08-4bbb-90a2-bc7532035072 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.568937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9bd0-2e08-4bbb-90a2-bc7532035072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.573479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.589582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-280a9bd0-2e08-4bbb-90a2-bc7532035072 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:57.591529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-280a9bd0-2e08-4bbb-90a2-bc7532035072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:57.657363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.673968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 541/1079] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:34:57.690337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe75f-eada-4173-86ed-616c945a6b01 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.696368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9bd0-2e08-4bbb-90a2-bc7532035072 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.735763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.736424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.736715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.736994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.737786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:57.738099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.739616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.752200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 539/1080] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:57.759041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:57.783188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.811161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9bd0-2e08-4bbb-90a2-bc7532035072 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.847462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.848354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.848641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.848914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.870186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98f0d-ceaa-44e1-8cbb-0806d0a0ea33 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:57.904596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:57.908329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:57.909342 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:57.909639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:57.909925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/c37e7d70e2864edaa125e8f5ac1a3373/roles/e8e71d6c1b3b4bfca8ce2509fc28017d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:57.912268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=c37e7d70e2864edaa125e8f5ac1a3373, role_id=e8e71d6c1b3b4bfca8ce2509fc28017d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.913706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.918836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:57.920328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:57.935252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 540/1081] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:34:57 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/c37e7d70e2864edaa125e8f5ac1a3373/roles/e8e71d6c1b3b4bfca8ce2509fc28017d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:34:58.037461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 542/1082] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:34:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:34:58.043655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:58.132825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:58.153199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fdaea-c557-4d97-b38e-314f859461f2 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:58.187733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf00fdf-4ee1-4267-ab5e-0a1e74de4535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:58.188517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf00fdf-4ee1-4267-ab5e-0a1e74de4535 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:58.188798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf00fdf-4ee1-4267-ab5e-0a1e74de4535 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:58.189070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf00fdf-4ee1-4267-ab5e-0a1e74de4535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:58.199894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf00fdf-4ee1-4267-ab5e-0a1e74de4535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:58.201464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf00fdf-4ee1-4267-ab5e-0a1e74de4535 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-2cf00fdf-4ee1-4267-ab5e-0a1e74de4535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:34:58.218570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:58.219750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:58.220676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:34:58.220676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:34:58.220676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:34:58.220676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:58.220676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 541/1083] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:58.226908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:58.316427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:58.329257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a511-4ecd-4f74-bd32-cd40cb64a937 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:58.362924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f76550-8db1-4564-9473-60adbedf4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:58.363606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f76550-8db1-4564-9473-60adbedf4eff None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:58.363890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f76550-8db1-4564-9473-60adbedf4eff None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:58.364165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f76550-8db1-4564-9473-60adbedf4eff None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:58.364876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f76550-8db1-4564-9473-60adbedf4eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:58.365182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f76550-8db1-4564-9473-60adbedf4eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:58.366551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f76550-8db1-4564-9473-60adbedf4eff None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:58.383328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 543/1084] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:34:59.586451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf350-a0fe-4232-946b-0499091207ce None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:59.587030 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf350-a0fe-4232-946b-0499091207ce None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:59.587030 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf350-a0fe-4232-946b-0499091207ce None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:59.588578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 542/1085] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:34:59.593507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9af18e-9b46-4682-930e-1f0cbfc79c19 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:59.593884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9af18e-9b46-4682-930e-1f0cbfc79c19 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:59.594210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9af18e-9b46-4682-930e-1f0cbfc79c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:59.611103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-fd9af18e-9b46-4682-930e-1f0cbfc79c19 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:34:59.612315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fd9af18e-9b46-4682-930e-1f0cbfc79c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:34:59.677552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 544/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:34:59.701902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf350-a0fe-4232-946b-0499091207ce None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:59.801174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf350-a0fe-4232-946b-0499091207ce None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:59.828339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:59.833614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b73a8-ca63-4a9f-b146-2c5d0177e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:59.834408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b73a8-ca63-4a9f-b146-2c5d0177e79a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:59.834696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b73a8-ca63-4a9f-b146-2c5d0177e79a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:59.834975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b73a8-ca63-4a9f-b146-2c5d0177e79a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:59.846131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b73a8-ca63-4a9f-b146-2c5d0177e79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-432b73a8-ca63-4a9f-b146-2c5d0177e79a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:34:59.853613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:34:59.854702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:34:59.855638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 543/1087] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:34:59.861262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9af18e-9b46-4682-930e-1f0cbfc79c19 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:34:59.935633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:59.956876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9af18e-9b46-4682-930e-1f0cbfc79c19 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:34:59.987792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015c72-952e-4c79-bfc4-b7a39950f429 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:59.988088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015c72-952e-4c79-bfc4-b7a39950f429 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:59.988367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015c72-952e-4c79-bfc4-b7a39950f429 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:59.989178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:34:59.989741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 544/1088] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:34:59.989934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:59.990113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:59.990392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:34:59.991143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:34:59.991481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:34:59.992856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:34:59.994961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380328-921a-41c1-b5d2-cd2c304412c9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:34:59.995274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380328-921a-41c1-b5d2-cd2c304412c9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:34:59.995563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380328-921a-41c1-b5d2-cd2c304412c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.001598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 545/1089] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:00.007036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.012573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0a380328-921a-41c1-b5d2-cd2c304412c9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:00.013754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0a380328-921a-41c1-b5d2-cd2c304412c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:00.079089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 545/1090] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:34:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:35:00.102250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380328-921a-41c1-b5d2-cd2c304412c9 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.103750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719fbc-2f9a-43d3-9596-8a8f7ae86e66 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.136902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.137797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.138116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.138476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] PATH_INFO: `/v3/users/92483f324e2847d6b1ace6759fd7d9e7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.139832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] RBAC: Authorizing `identity:get_user(user_id=92483f324e2847d6b1ace6759fd7d9e7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.141660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.144587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 546/1091] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/users/92483f324e2847d6b1ace6759fd7d9e7 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:35:00.150294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.161180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:00.202493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380328-921a-41c1-b5d2-cd2c304412c9 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.225634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:00.238508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.239348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.239638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.239918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.250031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcdae3-d473-452c-8fe4-9ebb129bc916 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.250983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:35:00.259152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:00.260277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:00.261170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 546/1092] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:35:00.266225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.286522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.287172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.287490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.287766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.355644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.357156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.364629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4eaa-2ddc-4506-9d36-0c480a07b491 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.366693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:00.399258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.399922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.400206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.400487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.401222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:00.401532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.402879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.410748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 547/1093] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:35:00.416907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.459489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 547/1094] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:35:00.462214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:00.465313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.523693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3487-e241-4b5f-92d9-afb197e08d3e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.559650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.560439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.560737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.561016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.565261 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2ce1d-26e2-48a1-9be9-bfc11bbd1adc None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.571733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.573773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.575673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:35:00.590916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:00.592227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:00.593146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:35:00.593146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:35:00.593146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:35:00.593146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:00.593146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 548/1095] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:35:00.597794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.601391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.602256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.602542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.602822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.604062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] RBAC: Authorizing `identity:get_project(project_id=7baba05d0aad4d57b649b3426486c082)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.605503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.612158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 548/1096] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/projects/7baba05d0aad4d57b649b3426486c082 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:00.613055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.692567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:00.699634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd012-3a41-40fb-b96d-0231f9e05625 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.713246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f86c-b626-418b-8144-8984b1add26c None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.733188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.733852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.734141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.734421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.735176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:00.735518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.737052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.746558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.747254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.747538 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.747815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.748635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=7baba05d0aad4d57b649b3426486c082, user.id=92483f324e2847d6b1ace6759fd7d9e7) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:00.748943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.749923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 549/1097] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:35:00.754541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.755423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.762346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 549/1098] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/role_assignments?user.id=92483f324e2847d6b1ace6759fd7d9e7&scope.project.id=7baba05d0aad4d57b649b3426486c082&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:35:00.864644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b392-1b0a-4847-87f5-53576b8eac37 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:00.901599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:00.902398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:00.902683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:00.902959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:00.911461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:00.912899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:35:00.928438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:00.929631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:00.930838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 550/1099] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:35:00.935962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:00.978194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:01.034832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a9e9-1bf0-4a2f-a7d9-f1ac6819fe62 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:01.068361 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:01.069030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:01.069317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:01.069598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:01.070432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:01.070746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:01.072203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:01.090529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 550/1100] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 23 13:35:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:01.096152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:01.114318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:01.195847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02ce8c-01e3-4e66-8fc1-5cf71773eb16 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:01.231249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:01.231945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:01.232270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:01.232554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:01.298700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:01.300190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:01.317714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:01.397169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 551/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 13:35:01.402931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:01.496768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:01.500516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43561-07df-4644-b667-2fc5629cd62d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:01.535117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:01.535931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:01.536217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:01.536496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:01.546288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:01.547781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:35:01.565464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:01.566493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:01.567644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:35:01.567644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:35:01.567644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:35:01.567644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:35:01.571285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 551/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:35:01.572433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:01.668190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e530906-075d-4b14-af0b-65369c3bbb27 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:01.684332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:01.701768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:01.702422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:01.702709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:01.702989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:01.703738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:01.704051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:01.705415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:01.716300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 552/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:35:01.721911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:01.818697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808cb6-6ccd-4c25-b5f9-62355ffde4a9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:01.852267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:01.853062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:01.853350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:01.853634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:01.860189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:01.861627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:35:01.875164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:01.876337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:35:01.877246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 552/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:35:01.882525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:01.978751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b2f34-73d2-42ac-8c91-d6e90ab405c4 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:02.010963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64777a17-e5c5-4ab6-bcb6-a67d8d7e79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:02.011645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64777a17-e5c5-4ab6-bcb6-a67d8d7e79f3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:02.011962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64777a17-e5c5-4ab6-bcb6-a67d8d7e79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:02.012239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64777a17-e5c5-4ab6-bcb6-a67d8d7e79f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:02.013014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64777a17-e5c5-4ab6-bcb6-a67d8d7e79f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:02.013320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64777a17-e5c5-4ab6-bcb6-a67d8d7e79f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:02.014737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64777a17-e5c5-4ab6-bcb6-a67d8d7e79f3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:02.026762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 553/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:02.032495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:02.045156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:02.129516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603492-2359-406b-a390-f81b7ceabbfb None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:02.161514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d862e-d270-4a5c-a8eb-6b085eae878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:02.162150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d862e-d270-4a5c-a8eb-6b085eae878b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:02.162434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d862e-d270-4a5c-a8eb-6b085eae878b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:02.162711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d862e-d270-4a5c-a8eb-6b085eae878b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:02.163560 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d862e-d270-4a5c-a8eb-6b085eae878b None admin] RBAC: Adding query filter params (role.id=e8e71d6c1b3b4bfca8ce2509fc28017d, scope.project.id=8aae95f970644f279053e3f140353481, user.id=c37e7d70e2864edaa125e8f5ac1a3373) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:02.163872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d862e-d270-4a5c-a8eb-6b085eae878b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:02.165286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d862e-d270-4a5c-a8eb-6b085eae878b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:02.170946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 553/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:02 2022] GET /identity/v3/role_assignments?user.id=c37e7d70e2864edaa125e8f5ac1a3373&scope.project.id=8aae95f970644f279053e3f140353481&role.id=e8e71d6c1b3b4bfca8ce2509fc28017d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:02.819409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e787d79-1554-496e-9bcf-9a1a97d242dd None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:02.819916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e787d79-1554-496e-9bcf-9a1a97d242dd None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:02.820011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e787d79-1554-496e-9bcf-9a1a97d242dd None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:02.821349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 554/1107] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:02.827402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eb1b8-1d17-4ca1-a1d6-97b9102aec9e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:02.827814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eb1b8-1d17-4ca1-a1d6-97b9102aec9e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:02.827976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eb1b8-1d17-4ca1-a1d6-97b9102aec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:02.845671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d55eb1b8-1d17-4ca1-a1d6-97b9102aec9e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:02.846861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d55eb1b8-1d17-4ca1-a1d6-97b9102aec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:02.914701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 554/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:35:02.939565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e787d79-1554-496e-9bcf-9a1a97d242dd None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:02.976748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:03.040640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e787d79-1554-496e-9bcf-9a1a97d242dd None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:03.073805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef8533-40c6-4c1d-9bd7-d1858980afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:03.074522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef8533-40c6-4c1d-9bd7-d1858980afc2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:03.074807 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef8533-40c6-4c1d-9bd7-d1858980afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:03.075083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef8533-40c6-4c1d-9bd7-d1858980afc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:03.076254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef8533-40c6-4c1d-9bd7-d1858980afc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:03.077682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef8533-40c6-4c1d-9bd7-d1858980afc2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:03.079289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 555/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:03.085397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eb1b8-1d17-4ca1-a1d6-97b9102aec9e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:03.088465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:03.180113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eb1b8-1d17-4ca1-a1d6-97b9102aec9e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:03.212091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a53fd3-8c1d-4039-98ee-b6d8791ab0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:03.212739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a53fd3-8c1d-4039-98ee-b6d8791ab0fa None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:03.213067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a53fd3-8c1d-4039-98ee-b6d8791ab0fa None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:03.213348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a53fd3-8c1d-4039-98ee-b6d8791ab0fa None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:03.214278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a53fd3-8c1d-4039-98ee-b6d8791ab0fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:03.216033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a53fd3-8c1d-4039-98ee-b6d8791ab0fa None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:03.236168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 555/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:35:03 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:35:05.265990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82529a3f-794d-47f7-8dfa-06c3b5552a04 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:05.266782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82529a3f-794d-47f7-8dfa-06c3b5552a04 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:05.266893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82529a3f-794d-47f7-8dfa-06c3b5552a04 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:05.268210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 556/1111] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:05.273448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52fda8-4b81-4e43-b4da-fd7c499816d1 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:05.273865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52fda8-4b81-4e43-b4da-fd7c499816d1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:05.274012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52fda8-4b81-4e43-b4da-fd7c499816d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:05.290151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-bc52fda8-4b81-4e43-b4da-fd7c499816d1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:05.291357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-bc52fda8-4b81-4e43-b4da-fd7c499816d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:05.344378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:05.356320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 556/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:05.379907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82529a3f-794d-47f7-8dfa-06c3b5552a04 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:05.477955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82529a3f-794d-47f7-8dfa-06c3b5552a04 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:05.480859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:05.512215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:05.513065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:05.513351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:05.513632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] PATH_INFO: `/v3/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:05.515084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] RBAC: Authorizing `identity:get_role(role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:05.516787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:05.518103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 557/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:05 2022] GET /identity/v3/roles/7375d2caebd143e29bfb064c04af61e7 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:05.523739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52fda8-4b81-4e43-b4da-fd7c499816d1 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:05.618241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52fda8-4b81-4e43-b4da-fd7c499816d1 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:05.650514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:05.651403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:05.651688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:05.651963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] PATH_INFO: `/v3/users/d86705be60bc4dd0a67886f9e475995d` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:05.664345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] RBAC: Authorizing `identity:get_user(user_id=d86705be60bc4dd0a67886f9e475995d)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:05.665766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:05.667924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 557/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:05 2022] GET /identity/v3/users/d86705be60bc4dd0a67886f9e475995d => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:05.673552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:05.769194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928773b-120d-4527-83a2-f0c6ccb3f709 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:05.801415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:05.802044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:05.802329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:05.802605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:05.841411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:05.866434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:05.867888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:05.960964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 558/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:35:05.966696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:06.014252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:06.063518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff66d-56de-4ccb-9d0d-f2228f8e1b0b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:06.096588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23dc11-c46d-4372-90e2-d06fe2db6c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:06.097433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23dc11-c46d-4372-90e2-d06fe2db6c1f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:06.097717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23dc11-c46d-4372-90e2-d06fe2db6c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:06.097998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23dc11-c46d-4372-90e2-d06fe2db6c1f None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:06.099146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23dc11-c46d-4372-90e2-d06fe2db6c1f None admin] RBAC: Authorizing `identity:get_project(project_id=7baba05d0aad4d57b649b3426486c082)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:06.100598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23dc11-c46d-4372-90e2-d06fe2db6c1f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:06.102247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 558/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:05 2022] GET /identity/v3/projects/7baba05d0aad4d57b649b3426486c082 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:06.108065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:06.176111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:06.204851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3aa20-3c69-4b44-be66-ca19405e71d0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:06.240623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58d507-5409-45fd-ba38-84d1677826fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:06.241270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58d507-5409-45fd-ba38-84d1677826fd None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:06.241556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58d507-5409-45fd-ba38-84d1677826fd None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:06.241835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58d507-5409-45fd-ba38-84d1677826fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:06.242686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58d507-5409-45fd-ba38-84d1677826fd None admin] RBAC: Adding query filter params (role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=7baba05d0aad4d57b649b3426486c082, user.id=d86705be60bc4dd0a67886f9e475995d) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:06.243000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58d507-5409-45fd-ba38-84d1677826fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:06.245065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58d507-5409-45fd-ba38-84d1677826fd None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:06.250349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 559/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:06 2022] GET /identity/v3/role_assignments?user.id=d86705be60bc4dd0a67886f9e475995d&scope.project.id=7baba05d0aad4d57b649b3426486c082&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:08.229754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400fc2-2292-41ab-9fe6-cb66a70d98cb None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:08.230368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400fc2-2292-41ab-9fe6-cb66a70d98cb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:08.230368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400fc2-2292-41ab-9fe6-cb66a70d98cb None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:08.231638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 559/1118] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:08.237165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d47b-6870-4793-b4da-4ac3ebc2afcd None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:08.237604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d47b-6870-4793-b4da-4ac3ebc2afcd None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:08.237957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d47b-6870-4793-b4da-4ac3ebc2afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:08.256209 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-7ec8d47b-6870-4793-b4da-4ac3ebc2afcd None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:08.257367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7ec8d47b-6870-4793-b4da-4ac3ebc2afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:08.321988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 560/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:35:08.344790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58400fc2-2292-41ab-9fe6-cb66a70d98cb None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:08.442294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58400fc2-2292-41ab-9fe6-cb66a70d98cb None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:08.458504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:08.476010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:08.476855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:08.477139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:08.477415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] PATH_INFO: `/v3/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:08.479402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] RBAC: Authorizing `identity:get_role(role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:08.480817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:08.482125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 560/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:08 2022] GET /identity/v3/roles/7375d2caebd143e29bfb064c04af61e7 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:08.488012 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8d47b-6870-4793-b4da-4ac3ebc2afcd None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:08.551350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:08.584683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8d47b-6870-4793-b4da-4ac3ebc2afcd None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:08.617206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:08.618065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:08.618352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:08.618632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] PATH_INFO: `/v3/users/d86705be60bc4dd0a67886f9e475995d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:08.620414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] RBAC: Authorizing `identity:get_user(user_id=d86705be60bc4dd0a67886f9e475995d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:08.621845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:08.623492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 561/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:08 2022] GET /identity/v3/users/d86705be60bc4dd0a67886f9e475995d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:08.629322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:08.724394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973b5a-da24-4681-a8fc-188c97307274 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:08.757542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6552cb-93f2-47ee-9448-7e7c172fd2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:08.758331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6552cb-93f2-47ee-9448-7e7c172fd2ba None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:08.758618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6552cb-93f2-47ee-9448-7e7c172fd2ba None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:08.758898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6552cb-93f2-47ee-9448-7e7c172fd2ba None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:08.760112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6552cb-93f2-47ee-9448-7e7c172fd2ba None admin] RBAC: Authorizing `identity:get_project(project_id=7baba05d0aad4d57b649b3426486c082)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:08.761542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6552cb-93f2-47ee-9448-7e7c172fd2ba None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:08.763417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 561/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:08 2022] GET /identity/v3/projects/7baba05d0aad4d57b649b3426486c082 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:08.769533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:08.866297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f47f4b-fc0a-4f32-8ec4-0b97e99469b0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:08.899625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a469b5-81e9-413f-9f1d-96dd93778305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:08.900521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a469b5-81e9-413f-9f1d-96dd93778305 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:08.900803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a469b5-81e9-413f-9f1d-96dd93778305 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:08.901081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a469b5-81e9-413f-9f1d-96dd93778305 None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082/users/d86705be60bc4dd0a67886f9e475995d/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:08.903253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a469b5-81e9-413f-9f1d-96dd93778305 None admin] RBAC: Authorizing `identity:create_grant(project_id=7baba05d0aad4d57b649b3426486c082, user_id=d86705be60bc4dd0a67886f9e475995d, role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:08.904669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a469b5-81e9-413f-9f1d-96dd93778305 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:08.906752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:08.917152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 562/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:35:08 2022] PUT /identity/v3/projects/7baba05d0aad4d57b649b3426486c082/users/d86705be60bc4dd0a67886f9e475995d/roles/7375d2caebd143e29bfb064c04af61e7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:35:10.892735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f67c6-a8ea-4321-a969-c55ac817e910 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:10.893289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f67c6-a8ea-4321-a969-c55ac817e910 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:10.893289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f67c6-a8ea-4321-a969-c55ac817e910 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:10.894642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 562/1124] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:10.899800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7abe-a267-4ff2-aad4-41a4416604ee None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:10.900263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7abe-a267-4ff2-aad4-41a4416604ee None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:10.900416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7abe-a267-4ff2-aad4-41a4416604ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:10.917728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d77f7abe-a267-4ff2-aad4-41a4416604ee None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:10.918886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d77f7abe-a267-4ff2-aad4-41a4416604ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:10.981296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 563/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:11.005136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f67c6-a8ea-4321-a969-c55ac817e910 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:11.057177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:11.103023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f67c6-a8ea-4321-a969-c55ac817e910 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:11.135447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:11.136286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:11.136567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:11.136840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] PATH_INFO: `/v3/roles/7375d2caebd143e29bfb064c04af61e7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:11.138272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] RBAC: Authorizing `identity:get_role(role_id=7375d2caebd143e29bfb064c04af61e7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:11.139666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:11.141000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 563/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:11 2022] GET /identity/v3/roles/7375d2caebd143e29bfb064c04af61e7 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:11.146872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f7abe-a267-4ff2-aad4-41a4416604ee None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:11.243136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f7abe-a267-4ff2-aad4-41a4416604ee None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:11.265151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:11.277116 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:11.277976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:11.278263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:11.278546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] PATH_INFO: `/v3/users/d86705be60bc4dd0a67886f9e475995d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:11.279745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] RBAC: Authorizing `identity:get_user(user_id=d86705be60bc4dd0a67886f9e475995d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:11.281178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:11.282792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 564/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:11 2022] GET /identity/v3/users/d86705be60bc4dd0a67886f9e475995d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:11.288395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:11.382553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cc7e3-7906-42f4-8439-e9cbd90f4046 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:11.402985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:11.416700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:11.417336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:11.417619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:11.417896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:11.481678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:11.483131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:11.577220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 564/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:35:11.582928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:11.678640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04fce-e840-47d0-b443-51be63323979 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:11.710920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07870a-3083-4bd4-a204-6019e04892b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:11.711781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07870a-3083-4bd4-a204-6019e04892b8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:11.712070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07870a-3083-4bd4-a204-6019e04892b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:11.712350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07870a-3083-4bd4-a204-6019e04892b8 None admin] PATH_INFO: `/v3/projects/7baba05d0aad4d57b649b3426486c082` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:11.714062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07870a-3083-4bd4-a204-6019e04892b8 None admin] RBAC: Authorizing `identity:get_project(project_id=7baba05d0aad4d57b649b3426486c082)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:11.715511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07870a-3083-4bd4-a204-6019e04892b8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:11.717199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 565/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:11 2022] GET /identity/v3/projects/7baba05d0aad4d57b649b3426486c082 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:11.723161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:11.743414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:11.823320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2510d1-c7f1-4f95-b712-98ccc641a7b5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:11.855544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63abbc-29e2-4e6f-9793-9017d0e9b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:11.856171 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63abbc-29e2-4e6f-9793-9017d0e9b9fe None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:11.856453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63abbc-29e2-4e6f-9793-9017d0e9b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:11.856728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63abbc-29e2-4e6f-9793-9017d0e9b9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:11.857548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63abbc-29e2-4e6f-9793-9017d0e9b9fe None admin] RBAC: Adding query filter params (role.id=7375d2caebd143e29bfb064c04af61e7, scope.project.id=7baba05d0aad4d57b649b3426486c082, user.id=d86705be60bc4dd0a67886f9e475995d) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:11.857860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63abbc-29e2-4e6f-9793-9017d0e9b9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:11.859307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63abbc-29e2-4e6f-9793-9017d0e9b9fe None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:11.864886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 565/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:11 2022] GET /identity/v3/role_assignments?user.id=d86705be60bc4dd0a67886f9e475995d&scope.project.id=7baba05d0aad4d57b649b3426486c082&role.id=7375d2caebd143e29bfb064c04af61e7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:13.894975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e15109-04cb-4a17-9dd3-ad30269cfb1f None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:13.895558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e15109-04cb-4a17-9dd3-ad30269cfb1f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:13.895558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e15109-04cb-4a17-9dd3-ad30269cfb1f None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:13.896922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 566/1131] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:13.901970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0183b4-396e-4d31-81b7-eb71d2bf6b5c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:13.902402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0183b4-396e-4d31-81b7-eb71d2bf6b5c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:13.902529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0183b4-396e-4d31-81b7-eb71d2bf6b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:13.919838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5a0183b4-396e-4d31-81b7-eb71d2bf6b5c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:13.920998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5a0183b4-396e-4d31-81b7-eb71d2bf6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:13.984942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 566/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:14.008454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e15109-04cb-4a17-9dd3-ad30269cfb1f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:14.066259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:14.106979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e15109-04cb-4a17-9dd3-ad30269cfb1f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:14.138831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b76b5-7f3a-4c7f-8bb0-45621e5490a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:14.139630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b76b5-7f3a-4c7f-8bb0-45621e5490a7 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:14.139920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b76b5-7f3a-4c7f-8bb0-45621e5490a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:14.140202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b76b5-7f3a-4c7f-8bb0-45621e5490a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:14.141361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b76b5-7f3a-4c7f-8bb0-45621e5490a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:14.143035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b76b5-7f3a-4c7f-8bb0-45621e5490a7 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:14.144634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 567/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:14.150811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0183b4-396e-4d31-81b7-eb71d2bf6b5c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:14.165225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:14.247454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0183b4-396e-4d31-81b7-eb71d2bf6b5c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:14.280941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77bdd5-3f0b-4453-9bff-468f8b6869a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:14.281593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77bdd5-3f0b-4453-9bff-468f8b6869a4 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:14.281882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77bdd5-3f0b-4453-9bff-468f8b6869a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:14.282162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77bdd5-3f0b-4453-9bff-468f8b6869a4 None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:14.282874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77bdd5-3f0b-4453-9bff-468f8b6869a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:14.284340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77bdd5-3f0b-4453-9bff-468f8b6869a4 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:14.309502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 567/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:35:14 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:35:16.322724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f882c8d-c67d-45ac-8e67-20fca7c51ff0 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:16.323297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f882c8d-c67d-45ac-8e67-20fca7c51ff0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:16.323297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f882c8d-c67d-45ac-8e67-20fca7c51ff0 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:16.324685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 568/1135] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:16.329905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11913-5bfa-4dbd-be10-9849a8550d79 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:16.330324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11913-5bfa-4dbd-be10-9849a8550d79 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:16.330457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11913-5bfa-4dbd-be10-9849a8550d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:16.347419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4bd11913-5bfa-4dbd-be10-9849a8550d79 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:16.348603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4bd11913-5bfa-4dbd-be10-9849a8550d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:16.406087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:16.414314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 568/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:16.439309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f882c8d-c67d-45ac-8e67-20fca7c51ff0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:16.537187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f882c8d-c67d-45ac-8e67-20fca7c51ff0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:16.562893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:16.571796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd1bd-60ec-4b31-aef3-0a1233c5455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:16.572637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd1bd-60ec-4b31-aef3-0a1233c5455f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:16.572980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd1bd-60ec-4b31-aef3-0a1233c5455f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:16.573213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd1bd-60ec-4b31-aef3-0a1233c5455f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:16.574411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffd1bd-60ec-4b31-aef3-0a1233c5455f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:16.575893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffd1bd-60ec-4b31-aef3-0a1233c5455f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:16.577534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 569/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:35:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:16.583290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11913-5bfa-4dbd-be10-9849a8550d79 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:16.678815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11913-5bfa-4dbd-be10-9849a8550d79 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:16.711210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a571a-7322-43bc-a556-7fe3aac1cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:16.711890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a571a-7322-43bc-a556-7fe3aac1cf2c None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:16.712176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a571a-7322-43bc-a556-7fe3aac1cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:16.712454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a571a-7322-43bc-a556-7fe3aac1cf2c None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:16.713785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a571a-7322-43bc-a556-7fe3aac1cf2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:16.715230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a571a-7322-43bc-a556-7fe3aac1cf2c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:16.733882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 569/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:35:16 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:35:18.758631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824cc20-4e12-4983-aff7-598d8f84223a None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:18.759146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824cc20-4e12-4983-aff7-598d8f84223a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:18.759146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824cc20-4e12-4983-aff7-598d8f84223a None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:18.761105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 570/1139] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:18.766323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aa5e0-7656-4626-9ca1-f189991bf6d9 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:18.766998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aa5e0-7656-4626-9ca1-f189991bf6d9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:18.767153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aa5e0-7656-4626-9ca1-f189991bf6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:18.783430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9d4aa5e0-7656-4626-9ca1-f189991bf6d9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:18.784601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9d4aa5e0-7656-4626-9ca1-f189991bf6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:18.829773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:18.849693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 570/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:18.873484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824cc20-4e12-4983-aff7-598d8f84223a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:18.970335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824cc20-4e12-4983-aff7-598d8f84223a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:19.003351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:19.004119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:19.004405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:19.004689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:19.014496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:35:19.022196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:19.023427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:19.024573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 571/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:35:19.030036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aa5e0-7656-4626-9ca1-f189991bf6d9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:19.125526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aa5e0-7656-4626-9ca1-f189991bf6d9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:19.158057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:19.158710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:19.158998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:19.159308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:19.160050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:19.160358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:19.161723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:19.170048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 571/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:19.175498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:19.230698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:19.272938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a3f94-b94d-423d-8b95-961155c5e625 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:19.305009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:19.305857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:19.306139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:19.306450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] PATH_INFO: `/v3/users/1a92347601d14ab2a117c3eff05d6b2a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:19.318958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] RBAC: Authorizing `identity:get_user(user_id=1a92347601d14ab2a117c3eff05d6b2a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:19.320422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:19.322087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 572/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:19 2022] GET /identity/v3/users/1a92347601d14ab2a117c3eff05d6b2a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:19.327668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:19.372061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:19.423705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7af68b-8f98-4a16-b7e4-4c5383d8cb53 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:19.454774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:19.455431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:19.455716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:19.455991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:19.521003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:19.522448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:19.564500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:19.617050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 572/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:35:19.622799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:19.716984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0fd9-cb5f-435d-85ea-28ae190b7bfe None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:19.730108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:19.749685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16165e60-031f-46d9-9d88-7702628bdd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:19.750523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16165e60-031f-46d9-9d88-7702628bdd26 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:19.750806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16165e60-031f-46d9-9d88-7702628bdd26 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:19.751080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16165e60-031f-46d9-9d88-7702628bdd26 None admin] PATH_INFO: `/v3/projects/5125271d0a7a454eb96ede6a8add51d3` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:19.752250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16165e60-031f-46d9-9d88-7702628bdd26 None admin] RBAC: Authorizing `identity:get_project(project_id=5125271d0a7a454eb96ede6a8add51d3)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:19.753654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16165e60-031f-46d9-9d88-7702628bdd26 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:19.755310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 573/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:19 2022] GET /identity/v3/projects/5125271d0a7a454eb96ede6a8add51d3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:35:19.761824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:19.856875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353a3c-19f5-4999-89a4-db61ca580416 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:19.889074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb7d07-bde7-43f7-8893-bc3abdcd822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:19.889711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb7d07-bde7-43f7-8893-bc3abdcd822a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:19.889999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb7d07-bde7-43f7-8893-bc3abdcd822a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:19.890276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb7d07-bde7-43f7-8893-bc3abdcd822a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:19.891092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb7d07-bde7-43f7-8893-bc3abdcd822a None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=5125271d0a7a454eb96ede6a8add51d3, user.id=1a92347601d14ab2a117c3eff05d6b2a) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:19.891688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb7d07-bde7-43f7-8893-bc3abdcd822a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:19.893125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb7d07-bde7-43f7-8893-bc3abdcd822a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:19.898346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 573/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:19 2022] GET /identity/v3/role_assignments?user.id=1a92347601d14ab2a117c3eff05d6b2a&scope.project.id=5125271d0a7a454eb96ede6a8add51d3&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:21.872340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cf76-dab3-43e2-ade2-b763be9cdd43 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:21.872861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cf76-dab3-43e2-ade2-b763be9cdd43 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:21.872954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72cf76-dab3-43e2-ade2-b763be9cdd43 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:21.874251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 574/1147] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:21.879420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e4468-d6a0-4733-a6c5-07a403d017db None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:21.879814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e4468-d6a0-4733-a6c5-07a403d017db None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:21.879989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e4468-d6a0-4733-a6c5-07a403d017db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:21.896936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-269e4468-d6a0-4733-a6c5-07a403d017db None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:21.898114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-269e4468-d6a0-4733-a6c5-07a403d017db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:21.900054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:21.963768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 574/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:21.986374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72cf76-dab3-43e2-ade2-b763be9cdd43 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:22.084900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72cf76-dab3-43e2-ade2-b763be9cdd43 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:22.117476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:22.118261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:22.118551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:22.118870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:22.128752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:35:22.136835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:22.138005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:22.139026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 575/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:35:22.144230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e4468-d6a0-4733-a6c5-07a403d017db None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:22.237972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e4468-d6a0-4733-a6c5-07a403d017db None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:22.271097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:22.271776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:22.272065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:22.272347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:22.273088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:22.273397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:22.274757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:22.279584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:22.283076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 575/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:35:22.288599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:22.331050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:22.385256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb482c7-f3db-45f1-b0e0-c3932601853f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:22.417218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:22.418078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:22.418394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:22.418679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] PATH_INFO: `/v3/users/1a92347601d14ab2a117c3eff05d6b2a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:22.419852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] RBAC: Authorizing `identity:get_user(user_id=1a92347601d14ab2a117c3eff05d6b2a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:22.421286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:22.422901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 576/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:22 2022] GET /identity/v3/users/1a92347601d14ab2a117c3eff05d6b2a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:22.428656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:22.526114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e4e0e-4546-4a58-8568-991d5755a26d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:22.558307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4755dbf-b72b-4277-ab20-ef89f5d29afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:22.559158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755dbf-b72b-4277-ab20-ef89f5d29afa None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:22.559476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755dbf-b72b-4277-ab20-ef89f5d29afa None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:22.559753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755dbf-b72b-4277-ab20-ef89f5d29afa None admin] PATH_INFO: `/v3/projects/5125271d0a7a454eb96ede6a8add51d3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:22.560895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4755dbf-b72b-4277-ab20-ef89f5d29afa None admin] RBAC: Authorizing `identity:get_project(project_id=5125271d0a7a454eb96ede6a8add51d3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:22.562357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4755dbf-b72b-4277-ab20-ef89f5d29afa None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:22.564051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 576/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:22 2022] GET /identity/v3/projects/5125271d0a7a454eb96ede6a8add51d3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:22.569878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:22.664935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bb45-a64e-4cf5-83c1-da42643e8648 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:22.675599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:22.698591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39f89a-f9e7-4d34-96c9-50d94b502dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:22.699495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f89a-f9e7-4d34-96c9-50d94b502dd6 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:22.699779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f89a-f9e7-4d34-96c9-50d94b502dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:22.700047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f89a-f9e7-4d34-96c9-50d94b502dd6 None admin] PATH_INFO: `/v3/projects/5125271d0a7a454eb96ede6a8add51d3/users/1a92347601d14ab2a117c3eff05d6b2a/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:22.701966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39f89a-f9e7-4d34-96c9-50d94b502dd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5125271d0a7a454eb96ede6a8add51d3, user_id=1a92347601d14ab2a117c3eff05d6b2a, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:22.703406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39f89a-f9e7-4d34-96c9-50d94b502dd6 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:22.715289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 577/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:35:22 2022] PUT /identity/v3/projects/5125271d0a7a454eb96ede6a8add51d3/users/1a92347601d14ab2a117c3eff05d6b2a/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:35:24.742759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0858f-11bc-4e65-85cb-080c7b55ce5e None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:24.743274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0858f-11bc-4e65-85cb-080c7b55ce5e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:24.743274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0858f-11bc-4e65-85cb-080c7b55ce5e None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:24.744667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 577/1154] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:24.749735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd61af-7f5e-4a4c-b63d-0c01fbc3be34 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:24.750113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd61af-7f5e-4a4c-b63d-0c01fbc3be34 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:24.750295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd61af-7f5e-4a4c-b63d-0c01fbc3be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:24.766784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-bdcd61af-7f5e-4a4c-b63d-0c01fbc3be34 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:24.767977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bdcd61af-7f5e-4a4c-b63d-0c01fbc3be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:24.831745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 578/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:24.855581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0858f-11bc-4e65-85cb-080c7b55ce5e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:24.920500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:24.953517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0858f-11bc-4e65-85cb-080c7b55ce5e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:24.985139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:24.985911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:24.986196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:24.986474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:24.998442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:35:25.011413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:25.012454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:35:25.013475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 578/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:35:25.019587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd61af-7f5e-4a4c-b63d-0c01fbc3be34 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:25.120865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:25.123961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd61af-7f5e-4a4c-b63d-0c01fbc3be34 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:25.156716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:25.157368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:25.157652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:25.157927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:25.158659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:25.158962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:25.160344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:25.168611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 579/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:25.174398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:25.269035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d73f7-94aa-4878-805e-2eb1a3944898 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:25.294437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:25.302095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:25.302948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:25.303252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:25.303536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] PATH_INFO: `/v3/users/1a92347601d14ab2a117c3eff05d6b2a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:25.304695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] RBAC: Authorizing `identity:get_user(user_id=1a92347601d14ab2a117c3eff05d6b2a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:25.306118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:25.307748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 579/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:25 2022] GET /identity/v3/users/1a92347601d14ab2a117c3eff05d6b2a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:25.313389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:25.414769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c899f-180e-46b8-9736-20c8171bfe85 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:25.447140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:25.447809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:25.448092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:25.448368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:25.480380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:25.517520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:25.518966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:25.614240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 580/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:35:25.620057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:25.719801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107775-fc01-4288-97ea-2ff36d007085 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:25.752331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae076-8b47-42e0-846f-4eecab970533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:25.753185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae076-8b47-42e0-846f-4eecab970533 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:25.753473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae076-8b47-42e0-846f-4eecab970533 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:25.753755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae076-8b47-42e0-846f-4eecab970533 None admin] PATH_INFO: `/v3/projects/5125271d0a7a454eb96ede6a8add51d3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:25.754918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae076-8b47-42e0-846f-4eecab970533 None admin] RBAC: Authorizing `identity:get_project(project_id=5125271d0a7a454eb96ede6a8add51d3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:25.756402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae076-8b47-42e0-846f-4eecab970533 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:25.758081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 580/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:25 2022] GET /identity/v3/projects/5125271d0a7a454eb96ede6a8add51d3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:25.764629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:25.823900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:25.861564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc876291-cc75-400f-8099-726424d5c4cc None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:25.894740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338be9-093a-4a10-bef8-20797c6e23d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:25.895355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338be9-093a-4a10-bef8-20797c6e23d2 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:25.895655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338be9-093a-4a10-bef8-20797c6e23d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:25.895940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338be9-093a-4a10-bef8-20797c6e23d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:25.896765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338be9-093a-4a10-bef8-20797c6e23d2 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=5125271d0a7a454eb96ede6a8add51d3, user.id=1a92347601d14ab2a117c3eff05d6b2a) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:25.897086 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338be9-093a-4a10-bef8-20797c6e23d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:25.898509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338be9-093a-4a10-bef8-20797c6e23d2 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:25.904948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 581/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:25 2022] GET /identity/v3/role_assignments?user.id=1a92347601d14ab2a117c3eff05d6b2a&scope.project.id=5125271d0a7a454eb96ede6a8add51d3&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:27.916356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb590e-0ec7-404b-9a59-c5f1bff7cd42 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:27.916900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb590e-0ec7-404b-9a59-c5f1bff7cd42 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:27.916900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb590e-0ec7-404b-9a59-c5f1bff7cd42 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:27.918258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 581/1162] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:27.923493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0653d1c-13e9-4d34-9145-109ab3ec0d2e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:27.923894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0653d1c-13e9-4d34-9145-109ab3ec0d2e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:27.924064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0653d1c-13e9-4d34-9145-109ab3ec0d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:27.940356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d0653d1c-13e9-4d34-9145-109ab3ec0d2e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:27.941533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d0653d1c-13e9-4d34-9145-109ab3ec0d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:28.005495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 582/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:28.029059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb590e-0ec7-404b-9a59-c5f1bff7cd42 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:28.089841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:28.126807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb590e-0ec7-404b-9a59-c5f1bff7cd42 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:28.160283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:28.160921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:28.161209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:28.161490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:28.225219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:28.226632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:28.283769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:28.321727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 582/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:35:28.328195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0653d1c-13e9-4d34-9145-109ab3ec0d2e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:28.381866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:28.426619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0653d1c-13e9-4d34-9145-109ab3ec0d2e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:28.472031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d023d6-fb0e-4023-ab94-f388483e86db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:28.472866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d023d6-fb0e-4023-ab94-f388483e86db None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:28.473183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d023d6-fb0e-4023-ab94-f388483e86db None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:28.473461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d023d6-fb0e-4023-ab94-f388483e86db None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:28.480594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d023d6-fb0e-4023-ab94-f388483e86db None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:28.482006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d023d6-fb0e-4023-ab94-f388483e86db None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-a6d023d6-fb0e-4023-ab94-f388483e86db None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:28.497394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:28.498802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:28.499977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 583/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:35:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:35:28.505170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:28.606655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170254-072a-41e2-9393-29ae5cb5b802 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:28.639806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4040638-3f4e-4107-a5a5-42fb8e344755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:28.640458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040638-3f4e-4107-a5a5-42fb8e344755 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:28.640746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040638-3f4e-4107-a5a5-42fb8e344755 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:28.641026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040638-3f4e-4107-a5a5-42fb8e344755 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:28.642004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4040638-3f4e-4107-a5a5-42fb8e344755 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:28.642312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4040638-3f4e-4107-a5a5-42fb8e344755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:28.643727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4040638-3f4e-4107-a5a5-42fb8e344755 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:28.650636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 583/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 23 13:35:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:30.638583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee79d-3cc1-4b96-a319-b1b981cde96b None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:30.639095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee79d-3cc1-4b96-a319-b1b981cde96b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:30.639231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee79d-3cc1-4b96-a319-b1b981cde96b None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:30.640594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 584/1167] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:30.647858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a72bc-59ac-4af9-91c9-9c890b6f9645 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:30.648295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a72bc-59ac-4af9-91c9-9c890b6f9645 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:30.648416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a72bc-59ac-4af9-91c9-9c890b6f9645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:30.666659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f21a72bc-59ac-4af9-91c9-9c890b6f9645 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:30.667863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f21a72bc-59ac-4af9-91c9-9c890b6f9645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:30.692016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:30.738467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 584/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:30.765527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccee79d-3cc1-4b96-a319-b1b981cde96b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:30.867234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccee79d-3cc1-4b96-a319-b1b981cde96b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:30.882356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:30.900898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f7a54-57cb-4765-b1eb-7507313070b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:30.901556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f7a54-57cb-4765-b1eb-7507313070b8 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:30.901847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f7a54-57cb-4765-b1eb-7507313070b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:30.902130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f7a54-57cb-4765-b1eb-7507313070b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:30.902861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f7a54-57cb-4765-b1eb-7507313070b8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:30.904262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f7a54-57cb-4765-b1eb-7507313070b8 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:30.917749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 585/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Thu Jun 23 13:35:30 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:35:33.038005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c793-369d-4dec-a36b-5533bfebf674 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:33.038537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c793-369d-4dec-a36b-5533bfebf674 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:33.038537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c793-369d-4dec-a36b-5533bfebf674 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:33.040113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 585/1170] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:33.045349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f767b95-7317-4656-b7bc-70a4d3ffe6e4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:33.045732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f767b95-7317-4656-b7bc-70a4d3ffe6e4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:33.045912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f767b95-7317-4656-b7bc-70a4d3ffe6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:33.062815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4f767b95-7317-4656-b7bc-70a4d3ffe6e4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:33.064032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4f767b95-7317-4656-b7bc-70a4d3ffe6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:33.128324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 586/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:33.152916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652c793-369d-4dec-a36b-5533bfebf674 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:33.252372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652c793-369d-4dec-a36b-5533bfebf674 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:33.284515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a65df8-ada0-4405-981d-b73a6e2944b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:33.285368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65df8-ada0-4405-981d-b73a6e2944b1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:33.285655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65df8-ada0-4405-981d-b73a6e2944b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:33.285937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65df8-ada0-4405-981d-b73a6e2944b1 None admin] PATH_INFO: `/v3/domains/a49e5cd7c3cf4d7ca2622b0724459cc3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:33.296630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a65df8-ada0-4405-981d-b73a6e2944b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a49e5cd7c3cf4d7ca2622b0724459cc3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:33.298043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a65df8-ada0-4405-981d-b73a6e2944b1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:33.299723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 586/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Jun 23 13:35:33 2022] GET /identity/v3/domains/a49e5cd7c3cf4d7ca2622b0724459cc3 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:33.305496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f767b95-7317-4656-b7bc-70a4d3ffe6e4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:33.400261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f767b95-7317-4656-b7bc-70a4d3ffe6e4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:33.407293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:33.434733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18df20-baf8-47a4-b8a8-cae53a6febce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:33.435414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18df20-baf8-47a4-b8a8-cae53a6febce None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:33.435699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18df20-baf8-47a4-b8a8-cae53a6febce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:33.435975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18df20-baf8-47a4-b8a8-cae53a6febce None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:33.436678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18df20-baf8-47a4-b8a8-cae53a6febce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:33.438095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18df20-baf8-47a4-b8a8-cae53a6febce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:33.466689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 587/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:35:33 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:35:35.494589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b424-376d-4f9f-ab05-182066849f53 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.495036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b424-376d-4f9f-ab05-182066849f53 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.495142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5b424-376d-4f9f-ab05-182066849f53 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.496548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 587/1174] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:35.501698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752701-862a-4834-816e-98fabdfddb7e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.502090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752701-862a-4834-816e-98fabdfddb7e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.502256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752701-862a-4834-816e-98fabdfddb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.519148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-03752701-862a-4834-816e-98fabdfddb7e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:35.520338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-03752701-862a-4834-816e-98fabdfddb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:35.583476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 588/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:35.607989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5b424-376d-4f9f-ab05-182066849f53 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:35.626624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:35.705608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5b424-376d-4f9f-ab05-182066849f53 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:35.737688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e931a-c676-470e-ba56-7c9474a20540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:35.738489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e931a-c676-470e-ba56-7c9474a20540 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.738774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e931a-c676-470e-ba56-7c9474a20540 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.739051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e931a-c676-470e-ba56-7c9474a20540 None admin] PATH_INFO: `/v3/domains/a49e5cd7c3cf4d7ca2622b0724459cc3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.740402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e931a-c676-470e-ba56-7c9474a20540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a49e5cd7c3cf4d7ca2622b0724459cc3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:35.741838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e931a-c676-470e-ba56-7c9474a20540 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:35.743948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 588/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Jun 23 13:35:35 2022] GET /identity/v3/domains/a49e5cd7c3cf4d7ca2622b0724459cc3 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:35.749418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752701-862a-4834-816e-98fabdfddb7e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:35.831946 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:35.844376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752701-862a-4834-816e-98fabdfddb7e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:35.876348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca5cd9-9b63-453b-b51d-51c6690fe8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:35.876995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca5cd9-9b63-453b-b51d-51c6690fe8bc None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:35.877279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca5cd9-9b63-453b-b51d-51c6690fe8bc None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:35.877553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca5cd9-9b63-453b-b51d-51c6690fe8bc None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:35.878263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca5cd9-9b63-453b-b51d-51c6690fe8bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:35.879703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca5cd9-9b63-453b-b51d-51c6690fe8bc None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:35.899467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 589/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:35:35 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:35:37.951991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19dc2-aaca-4e21-aeca-b4803c45bc07 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:37.952515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19dc2-aaca-4e21-aeca-b4803c45bc07 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:37.952632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19dc2-aaca-4e21-aeca-b4803c45bc07 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:37.953930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 589/1178] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:37.959170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85af23-227f-4733-9eed-5aa0e113fcdc None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:37.959598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85af23-227f-4733-9eed-5aa0e113fcdc None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:37.959755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85af23-227f-4733-9eed-5aa0e113fcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:37.976609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1f85af23-227f-4733-9eed-5aa0e113fcdc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:37.978284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1f85af23-227f-4733-9eed-5aa0e113fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:38.042584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 590/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:38.065486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19dc2-aaca-4e21-aeca-b4803c45bc07 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:38.148790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:38.164731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19dc2-aaca-4e21-aeca-b4803c45bc07 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:38.196861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:38.197640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:38.197928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:38.198209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:38.208488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:35:38.216653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:38.217665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:35:38.218652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 590/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:35:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:35:38.224024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85af23-227f-4733-9eed-5aa0e113fcdc None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:38.298348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:38.322982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85af23-227f-4733-9eed-5aa0e113fcdc None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:38.355504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:38.356156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:38.356436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:38.356712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:38.357446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:38.357752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:38.359102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:38.366827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 591/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:35:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:38.372592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:38.469491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9fd1f-f5c8-424a-a6b0-75a4d5540596 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:38.502169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:38.503131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:38.503451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:38.503733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] PATH_INFO: `/v3/users/94ffd41ea7c147558c2bb9fcff214850` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:38.517067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] RBAC: Authorizing `identity:get_user(user_id=94ffd41ea7c147558c2bb9fcff214850)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:38.518516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:38.520192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 591/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:38 2022] GET /identity/v3/users/94ffd41ea7c147558c2bb9fcff214850 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:38.526348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:38.624316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38fc4-c8c0-4d10-b37d-994c36c576ce None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:38.657684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:38.658325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:38.658615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:38.658896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:38.662232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:38.723790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:38.725171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:38.819011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 592/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:35:38.825631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:38.829311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:38.929919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b906-b7e7-478f-bb53-19c42971f486 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:38.962394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa54b93-309a-41ce-a6ca-df18448787b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:38.963268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54b93-309a-41ce-a6ca-df18448787b2 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:38.963551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54b93-309a-41ce-a6ca-df18448787b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:38.963824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54b93-309a-41ce-a6ca-df18448787b2 None admin] PATH_INFO: `/v3/projects/18f68912eb004e2492fadee9a68055b7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:38.964967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa54b93-309a-41ce-a6ca-df18448787b2 None admin] RBAC: Authorizing `identity:get_project(project_id=18f68912eb004e2492fadee9a68055b7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:38.966394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa54b93-309a-41ce-a6ca-df18448787b2 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:38.968070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 592/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:38 2022] GET /identity/v3/projects/18f68912eb004e2492fadee9a68055b7 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:38.974149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:39.006870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:39.069274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364e012-9f97-48d5-afc7-a1e2545f268c None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:39.101732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f99bd0-1e6c-4de1-a96c-761569f1c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:39.102369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f99bd0-1e6c-4de1-a96c-761569f1c520 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:39.102655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f99bd0-1e6c-4de1-a96c-761569f1c520 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:39.103003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f99bd0-1e6c-4de1-a96c-761569f1c520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:39.103851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f99bd0-1e6c-4de1-a96c-761569f1c520 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=18f68912eb004e2492fadee9a68055b7, user.id=94ffd41ea7c147558c2bb9fcff214850) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:39.104165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f99bd0-1e6c-4de1-a96c-761569f1c520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:39.105580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f99bd0-1e6c-4de1-a96c-761569f1c520 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:39.110900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 593/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:38 2022] GET /identity/v3/role_assignments?user.id=94ffd41ea7c147558c2bb9fcff214850&scope.project.id=18f68912eb004e2492fadee9a68055b7&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:41.125292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c487ec-e497-4e68-ab40-0624241fb4a2 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:41.125846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c487ec-e497-4e68-ab40-0624241fb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:41.125846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c487ec-e497-4e68-ab40-0624241fb4a2 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:41.127234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 593/1186] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:41.132561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a508-20ac-4ca6-b962-62111f9469e7 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:41.132978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a508-20ac-4ca6-b962-62111f9469e7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:41.133126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a508-20ac-4ca6-b962-62111f9469e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:41.149537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-98a5a508-20ac-4ca6-b962-62111f9469e7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:41.151175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-98a5a508-20ac-4ca6-b962-62111f9469e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:41.214352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 594/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:41.236863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c487ec-e497-4e68-ab40-0624241fb4a2 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:41.305183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:41.333637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c487ec-e497-4e68-ab40-0624241fb4a2 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:41.366410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:41.367183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:41.367500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:41.367780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:41.377539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:35:41.385533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:41.386676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:35:41.387807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 594/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:35:41.392976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5a508-20ac-4ca6-b962-62111f9469e7 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:41.423609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:41.490513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5a508-20ac-4ca6-b962-62111f9469e7 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:41.523356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:41.524015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:41.524301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:41.524620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:41.525865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:41.526174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:41.527608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:41.535385 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 595/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:41.541009 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:41.636371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beccd64-67ba-403f-b924-fd831292b1f6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:41.664082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:41.669146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:41.669993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:41.670281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:41.670557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] PATH_INFO: `/v3/users/94ffd41ea7c147558c2bb9fcff214850` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:41.671745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] RBAC: Authorizing `identity:get_user(user_id=94ffd41ea7c147558c2bb9fcff214850)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:41.673185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:41.674760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 595/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:41 2022] GET /identity/v3/users/94ffd41ea7c147558c2bb9fcff214850 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:41.680294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:41.768384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:41.777360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c66b-546e-4669-835d-22f213272d49 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:41.809140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f89bc1-bdc4-4264-9763-725f1e6f6190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:41.809976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89bc1-bdc4-4264-9763-725f1e6f6190 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:41.810262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89bc1-bdc4-4264-9763-725f1e6f6190 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:41.810536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89bc1-bdc4-4264-9763-725f1e6f6190 None admin] PATH_INFO: `/v3/projects/18f68912eb004e2492fadee9a68055b7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:41.811707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f89bc1-bdc4-4264-9763-725f1e6f6190 None admin] RBAC: Authorizing `identity:get_project(project_id=18f68912eb004e2492fadee9a68055b7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:41.813113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f89bc1-bdc4-4264-9763-725f1e6f6190 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:41.814758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 596/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:41 2022] GET /identity/v3/projects/18f68912eb004e2492fadee9a68055b7 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:41.820491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:41.944524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f124d-ed1d-461f-bac8-d64d79df9135 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:41.980839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813cc19-9036-4cf8-869f-0c3c4faa4cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:41.981753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813cc19-9036-4cf8-869f-0c3c4faa4cc0 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:41.982043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813cc19-9036-4cf8-869f-0c3c4faa4cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:41.982357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813cc19-9036-4cf8-869f-0c3c4faa4cc0 None admin] PATH_INFO: `/v3/projects/18f68912eb004e2492fadee9a68055b7/users/94ffd41ea7c147558c2bb9fcff214850/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:41.984330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813cc19-9036-4cf8-869f-0c3c4faa4cc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=18f68912eb004e2492fadee9a68055b7, user_id=94ffd41ea7c147558c2bb9fcff214850, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:41.986224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813cc19-9036-4cf8-869f-0c3c4faa4cc0 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:42.001836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 596/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:35:41 2022] PUT /identity/v3/projects/18f68912eb004e2492fadee9a68055b7/users/94ffd41ea7c147558c2bb9fcff214850/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:35:44.002858 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a64e-1b39-408e-a467-87026ffb88d3 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:44.003431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a64e-1b39-408e-a467-87026ffb88d3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:44.003431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a64e-1b39-408e-a467-87026ffb88d3 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:44.004824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 597/1193] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:35:44.009837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ca01-741d-49d4-90f1-8e1bc8849ebe None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:44.010211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ca01-741d-49d4-90f1-8e1bc8849ebe None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:44.010400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ca01-741d-49d4-90f1-8e1bc8849ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:44.027347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2b45ca01-741d-49d4-90f1-8e1bc8849ebe None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:35:44.028508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2b45ca01-741d-49d4-90f1-8e1bc8849ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:35:44.081015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:44.092867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 597/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:35:44.116111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145a64e-1b39-408e-a467-87026ffb88d3 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:44.214192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145a64e-1b39-408e-a467-87026ffb88d3 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:44.247313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:44.248096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:44.248402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:44.248683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:44.258939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:35:44.266838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:35:44.267956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:35:44.269016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 598/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:35:44.273857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ca01-741d-49d4-90f1-8e1bc8849ebe None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:44.369035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ca01-741d-49d4-90f1-8e1bc8849ebe None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:44.402456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:44.403113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:44.403426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:44.403710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:44.404451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:44.404762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:44.406130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:44.413920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 598/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:44.419573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:44.440531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:44.517570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655ca8-c603-4c16-9e22-37afc107d6f1 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:44.550137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:44.550997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:44.551315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:44.551602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] PATH_INFO: `/v3/users/94ffd41ea7c147558c2bb9fcff214850` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:44.552769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=94ffd41ea7c147558c2bb9fcff214850)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:44.554196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:44.555844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 599/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 23 13:35:44 2022] GET /identity/v3/users/94ffd41ea7c147558c2bb9fcff214850 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:44.561539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:44.612746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:44.659070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885402-f490-4be6-b1df-4530f9f299ce None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:44.690709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:44.691370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:44.691659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:44.691937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:44.756386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:44.757831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:44.806764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:44.852409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 599/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:35:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:35:44.858198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:44.943778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:44.956206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ad644-64a3-4766-b175-f4dc853da2b3 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:44.987842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb48355-f93f-435e-8f59-053e2571c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:44.988684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48355-f93f-435e-8f59-053e2571c898 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:44.988969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48355-f93f-435e-8f59-053e2571c898 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:44.989245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48355-f93f-435e-8f59-053e2571c898 None admin] PATH_INFO: `/v3/projects/18f68912eb004e2492fadee9a68055b7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:44.990392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb48355-f93f-435e-8f59-053e2571c898 None admin] RBAC: Authorizing `identity:get_project(project_id=18f68912eb004e2492fadee9a68055b7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:44.991841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb48355-f93f-435e-8f59-053e2571c898 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:44.993994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 600/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 23 13:35:44 2022] GET /identity/v3/projects/18f68912eb004e2492fadee9a68055b7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:44.999958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:35:45.094233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379406fb-f42f-4186-a1d9-2d623d031d23 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:35:45.126736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17682b-7dd0-4a81-b65a-35c58f55c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:35:45.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17682b-7dd0-4a81-b65a-35c58f55c81c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:35:45.127715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17682b-7dd0-4a81-b65a-35c58f55c81c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:35:45.127996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17682b-7dd0-4a81-b65a-35c58f55c81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:35:45.128822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17682b-7dd0-4a81-b65a-35c58f55c81c None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=18f68912eb004e2492fadee9a68055b7, user.id=94ffd41ea7c147558c2bb9fcff214850) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:35:45.129138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17682b-7dd0-4a81-b65a-35c58f55c81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:35:45.130577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17682b-7dd0-4a81-b65a-35c58f55c81c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:35:45.136863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 600/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:35:44 2022] GET /identity/v3/role_assignments?user.id=94ffd41ea7c147558c2bb9fcff214850&scope.project.id=18f68912eb004e2492fadee9a68055b7&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:35:54.983880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=22 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:35:55.134144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:40.067834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e331-25e7-4b54-94ec-db28227cd597 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:40.068506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e331-25e7-4b54-94ec-db28227cd597 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:40.068506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e331-25e7-4b54-94ec-db28227cd597 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:40.070468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 601/1201] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:36:40.075952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda245-3ee4-4371-bd94-27403be0e4d6 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:40.076433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda245-3ee4-4371-bd94-27403be0e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:40.076529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda245-3ee4-4371-bd94-27403be0e4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:40.095247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8bbda245-3ee4-4371-bd94-27403be0e4d6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:36:40.096451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8bbda245-3ee4-4371-bd94-27403be0e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:36:40.180609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 601/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:36:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:36:40.207351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7e331-25e7-4b54-94ec-db28227cd597 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:40.350290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7e331-25e7-4b54-94ec-db28227cd597 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:40.398302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:40.399105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:40.399425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:40.399717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:40.412712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:40.414698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:40.437989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:40.439074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:40.444566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:40.444566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:40.444566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:40.444566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:40.444566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 602/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:40.445789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbda245-3ee4-4371-bd94-27403be0e4d6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:40.589587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbda245-3ee4-4371-bd94-27403be0e4d6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:40.628608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:40.636912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dc48e-3ab1-4ea6-901d-6b659b025c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:40.637974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dc48e-3ab1-4ea6-901d-6b659b025c8c None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:40.638356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dc48e-3ab1-4ea6-901d-6b659b025c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:40.639038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dc48e-3ab1-4ea6-901d-6b659b025c8c None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:40.640252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dc48e-3ab1-4ea6-901d-6b659b025c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:40.640649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dc48e-3ab1-4ea6-901d-6b659b025c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:40.642746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dc48e-3ab1-4ea6-901d-6b659b025c8c None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:40.656834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 602/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:40.664216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:40.737904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:40.805996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c773b3-bdc9-4909-a300-5a8c809091ae None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:40.853184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839f1e9-b8b5-42b6-b8f7-8b8df7b9be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:40.855557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f1e9-b8b5-42b6-b8f7-8b8df7b9be02 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:40.855947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f1e9-b8b5-42b6-b8f7-8b8df7b9be02 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:40.856249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f1e9-b8b5-42b6-b8f7-8b8df7b9be02 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:40.857111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839f1e9-b8b5-42b6-b8f7-8b8df7b9be02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:40.858704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839f1e9-b8b5-42b6-b8f7-8b8df7b9be02 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:40.884418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 603/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 23 13:36:40 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:36:43.102200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea586-8e73-4143-bcf6-3464d8df573c None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:43.102775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea586-8e73-4143-bcf6-3464d8df573c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:43.102775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea586-8e73-4143-bcf6-3464d8df573c None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:43.104160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 603/1206] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:36:43.109890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0468d18-c6be-48a5-89c2-ff68e8a005b3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:43.110341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0468d18-c6be-48a5-89c2-ff68e8a005b3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:43.110434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0468d18-c6be-48a5-89c2-ff68e8a005b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:43.133940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-a0468d18-c6be-48a5-89c2-ff68e8a005b3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:36:43.135221 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a0468d18-c6be-48a5-89c2-ff68e8a005b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:36:43.217645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 604/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:36:43.241668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea586-8e73-4143-bcf6-3464d8df573c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:43.360790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea586-8e73-4143-bcf6-3464d8df573c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:43.399176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:43.399991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:43.400297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:43.400578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:43.412794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:36:43.420819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:43.422084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:43.422958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 604/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:43.427996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0468d18-c6be-48a5-89c2-ff68e8a005b3 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:43.480207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:43.549160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0468d18-c6be-48a5-89c2-ff68e8a005b3 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:43.592796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:43.593483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:43.593760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:43.594036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:43.594810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:43.595185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:43.596570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:43.612572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 605/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:43.618655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:43.679921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:43.740885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1c77-66db-4011-bbd1-972dc35d3986 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:43.785262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:43.786072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:43.786343 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:43.786623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:43.797198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:43.798680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:43.818741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:43.820523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:43.821630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:43.821630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:43.821630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:43.821630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:43.821630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 605/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:43.828234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:43.956421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:43.959165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805771d7-4d7d-4210-89d7-28f4b19a2c90 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:44.004897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:44.008084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:44.008429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:44.008713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:44.009468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:44.009780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:44.011178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:44.025755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 606/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:44.033720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:44.182491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b99bec-a3c5-4000-83b0-9de43ca6ef33 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:44.184505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:44.223629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:44.224594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:44.224970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:44.225364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:44.235863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:44.237842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:36:44.266419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:44.267885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:44.268970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:44.269768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 606/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:44.275040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:44.413094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc2446-0d72-4105-bbbc-f93a80210d6a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:44.455181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:44.456705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:44.456705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:44.456705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:44.457297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:44.457615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:44.459135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:44.488751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 607/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 23 13:36:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:44.495975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:44.621694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97864-68c2-49a0-8e09-fbc4217e93f3 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:44.660638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:44.661385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:44.661976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:44.661976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:44.696145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:44.741550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:44.743636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:44.862968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 607/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:36:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:36:44.868787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:44.888089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:44.984430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42a6ff-ab98-41ef-884b-0bb457d49084 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:45.021679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:45.022808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:45.024065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:45.024393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:45.034859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:45.036335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:45.054765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:45.063791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:45.065035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:45.065035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:45.065035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:45.065035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:45.065035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 608/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:45.065558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:45.127016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:45.169532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6d39-9db2-4f60-a86d-bcaf8921124b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:45.207169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:45.209454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:45.209454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:45.209454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:45.209454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:45.209759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:45.211596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:45.229606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 608/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:45.231370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:45.313831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:45.350196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1517a-6da0-4ebc-986b-2be6a8c43908 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:45.392818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:45.393995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:45.394480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:45.394991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:45.405410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:45.407197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:36:45.422754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:45.423791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:45.424681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:45.426937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 609/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:36:45.433282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:45.559547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a067-c15f-4eaa-8f17-3f230a991c2e None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:45.587601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:45.605317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77897ee6-c8e6-4be4-90b9-50705393341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:45.605990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77897ee6-c8e6-4be4-90b9-50705393341b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:45.606287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77897ee6-c8e6-4be4-90b9-50705393341b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:45.606663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77897ee6-c8e6-4be4-90b9-50705393341b None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:45.607655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77897ee6-c8e6-4be4-90b9-50705393341b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:45.607980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77897ee6-c8e6-4be4-90b9-50705393341b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:45.609682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77897ee6-c8e6-4be4-90b9-50705393341b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:45.624412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 609/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:45.630589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:45.755444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fd8c-2f7f-4235-89be-43bd7bac89c0 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:45.786740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:45.793958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35317c74-ecdc-4f9d-92fe-cc2dda3aa556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:45.794970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317c74-ecdc-4f9d-92fe-cc2dda3aa556 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:45.795504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317c74-ecdc-4f9d-92fe-cc2dda3aa556 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:45.796018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35317c74-ecdc-4f9d-92fe-cc2dda3aa556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:45.796866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317c74-ecdc-4f9d-92fe-cc2dda3aa556 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=5937de29a4c04fb9ab79f5ef77b24a10) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:45.797182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317c74-ecdc-4f9d-92fe-cc2dda3aa556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:45.798768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35317c74-ecdc-4f9d-92fe-cc2dda3aa556 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:45.805246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 610/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:36:45 2022] GET /identity/v3/role_assignments?user.id=5937de29a4c04fb9ab79f5ef77b24a10&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:47.862547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da766e9-2e2c-4a7c-b28c-ce434e488834 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:47.863076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da766e9-2e2c-4a7c-b28c-ce434e488834 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:47.863076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da766e9-2e2c-4a7c-b28c-ce434e488834 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:47.864594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 610/1220] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:36:47.871508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9f557-1b63-4e9b-93e0-0efb694e2810 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:47.871954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9f557-1b63-4e9b-93e0-0efb694e2810 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:47.871954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9f557-1b63-4e9b-93e0-0efb694e2810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:47.889099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b0c9f557-1b63-4e9b-93e0-0efb694e2810 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:36:47.890298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b0c9f557-1b63-4e9b-93e0-0efb694e2810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:36:47.979276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 611/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:36:48.000134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da766e9-2e2c-4a7c-b28c-ce434e488834 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:48.113892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da766e9-2e2c-4a7c-b28c-ce434e488834 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:48.150952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:48.151774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:48.152061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:48.152338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:48.163623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:36:48.172445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:48.173606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:36:48.174473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:48.179647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 611/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:48.180797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9f557-1b63-4e9b-93e0-0efb694e2810 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:48.299366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9f557-1b63-4e9b-93e0-0efb694e2810 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:48.326047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:48.338549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:48.339268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:48.339657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:48.339820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:48.340605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:48.340890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:48.342263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:48.358375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 612/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:48.359726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:48.413271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:48.475954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950229-af52-4b33-98e0-56bb4def120d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:48.514878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:48.515709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:48.515996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:48.516274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:48.528060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:48.529519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:48.546454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:48.547587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:48.548643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:48.548643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:48.548643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:48.548643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:48.548643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 612/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:48.553694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:48.665041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a59d2c-44da-4a50-bcb9-2e702a1babb5 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:48.701231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:48.701899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:48.702187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:48.702456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:48.703167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:48.703501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:48.705175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:48.719041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 613/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:48.724983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:48.831039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:48.839866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a6929-7639-4d39-b214-b668117b4b7d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:48.879131 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:48.880018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:48.880373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:48.880800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:48.890980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:48.892755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:36:48.909279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:48.910718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:48.911877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 613/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:48.917706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:48.969276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:49.029284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771f37e-5e0c-4d5c-a340-e5b0351e0560 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:49.065912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:49.066670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:49.066970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:49.067277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:49.068134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:49.068510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:49.070206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:49.089084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 614/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 23 13:36:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:49.095112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:49.216840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347840a-c84e-445f-ae82-aaf9c203f23d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:49.263755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:49.264961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:49.265285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:49.265716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:49.279443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:49.281029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:49.299476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:49.300626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:49.301865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:49.301865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:49.301865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:49.301865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:49.301865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 614/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:36:49.306696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:49.416186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac94636-2d44-494e-8629-08512182ace9 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:49.418951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:49.457930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:49.458765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:49.459156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:49.459489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:49.460910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:49.461322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:49.462997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:49.478832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 615/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:49.485027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:49.495769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:49.605967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3479-9f2d-42ea-ae8f-ed8d79e00423 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:49.642932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:49.643963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:49.644478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:49.644905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:49.653638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:49.655465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:36:49.669644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:49.670945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:49.672105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:49.673341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 615/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:49.679469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:49.797379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1872f-1e6d-45ac-b8bf-402d35d8298d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:49.837126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d44cb-8cf6-4f73-bbb0-1b12bc07cd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:49.838141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d44cb-8cf6-4f73-bbb0-1b12bc07cd1b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:49.838562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d44cb-8cf6-4f73-bbb0-1b12bc07cd1b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:49.838945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d44cb-8cf6-4f73-bbb0-1b12bc07cd1b None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:49.839766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d44cb-8cf6-4f73-bbb0-1b12bc07cd1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:49.840074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d44cb-8cf6-4f73-bbb0-1b12bc07cd1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:49.841508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d44cb-8cf6-4f73-bbb0-1b12bc07cd1b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:49.859584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 616/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:49.866669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:49.950802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:49.994922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5af3e-cdf4-4e0d-bfb1-5b32943ddbec None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:50.035402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df182b9-51ee-4559-8e1f-fca3f3898bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:50.036396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df182b9-51ee-4559-8e1f-fca3f3898bd9 None admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:50.036678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df182b9-51ee-4559-8e1f-fca3f3898bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:50.037024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df182b9-51ee-4559-8e1f-fca3f3898bd9 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/5937de29a4c04fb9ab79f5ef77b24a10/roles/fae6b286f5584beb868e5087cbf3d351` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:50.053589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df182b9-51ee-4559-8e1f-fca3f3898bd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=5937de29a4c04fb9ab79f5ef77b24a10, role_id=fae6b286f5584beb868e5087cbf3d351)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:50.055502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df182b9-51ee-4559-8e1f-fca3f3898bd9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:50.070499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 616/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:36:49 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/5937de29a4c04fb9ab79f5ef77b24a10/roles/fae6b286f5584beb868e5087cbf3d351 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:36:52.116180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584568a-4dc9-4ad8-9373-54996739bd62 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:52.116758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584568a-4dc9-4ad8-9373-54996739bd62 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:52.116852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584568a-4dc9-4ad8-9373-54996739bd62 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:52.118159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 617/1233] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:36:52.123486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a23ef-6b09-4f4c-8cf8-164687066e85 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:52.123895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a23ef-6b09-4f4c-8cf8-164687066e85 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:52.124107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a23ef-6b09-4f4c-8cf8-164687066e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:52.140705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-452a23ef-6b09-4f4c-8cf8-164687066e85 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:36:52.142137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-452a23ef-6b09-4f4c-8cf8-164687066e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:36:52.216974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 617/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:36:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:36:52.240910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584568a-4dc9-4ad8-9373-54996739bd62 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:52.271050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:52.353156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584568a-4dc9-4ad8-9373-54996739bd62 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:52.393573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:52.394375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:52.394719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:52.395012 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:52.408244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:36:52.416122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:52.417214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:52.418414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 618/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 23 13:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:36:52.423589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a23ef-6b09-4f4c-8cf8-164687066e85 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:52.475020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:52.537091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a23ef-6b09-4f4c-8cf8-164687066e85 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:52.573956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:52.574621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:52.574913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:52.575186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:52.575953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:52.576262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:52.577629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:52.585994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 618/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 23 13:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:52.591700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:52.682417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:52.699664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571b37f-db6b-499e-87a3-5373abf9a8fb None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:52.735492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:52.736384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:52.736673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:52.736955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:52.749177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:52.750687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:52.767979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:52.769234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:52.770473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:52.770473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:52.770473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:52.770473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:52.770473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 619/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:36:52.775311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:52.879806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d6e07-641f-4f8f-9d00-f24140d3abb5 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:52.889344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:52.915532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:52.916198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:52.916481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:52.916755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:52.917466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:52.917772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:52.919148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:52.935816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 619/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:52.937050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:53.048426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e8f0-b3de-488b-9f16-a0b46621d571 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:53.085967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:53.086799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:53.087089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:53.087455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:53.091114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:53.097048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:53.099043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:36:53.115767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:53.117371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:53.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 620/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:53.123570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:53.237842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632923e4-d731-43ca-a7ca-da99fa6ddfd6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:53.282159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:53.283023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:53.283451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:53.283751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:53.284708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:53.285033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:53.286544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:53.307195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 620/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 23 13:36:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:53.313951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:53.435709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb917197-38d7-4ec4-a587-9caa3974678e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:53.479028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:53.479711 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:53.480000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:53.480281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:53.546408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:53.553927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:53.555745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:53.668638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 621/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:36:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:36:53.674438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:53.703858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:53.784153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceb033-3f23-497a-b895-57f4e95e0be1 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:53.820885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:53.821684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:53.821972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:53.822250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:53.833710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:53.836302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:53.855360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:53.856578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:53.862394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:53.862394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:53.862394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:53.862394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:53.862394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 621/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:53.862687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:53.966469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:53.972745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e278-bc28-4d9b-b48f-c45a62698242 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:54.012707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:54.013372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:54.013660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:54.013940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:54.014657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:54.014967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:54.016365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:54.028655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 622/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:54.034408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:54.113562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:54.137764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d346f95-799d-498f-a8e2-f4f191a5eea8 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:54.174558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:54.175523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:54.175928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:54.176189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:54.183594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:54.185301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:36:54.201214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:54.202283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:54.203470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 622/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:54.208487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:54.317015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0a3f0-91a9-4135-941b-958ca712ea8a None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:54.355568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d732c-289d-4794-8009-f59302b56dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:54.356348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d732c-289d-4794-8009-f59302b56dee None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:54.356635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d732c-289d-4794-8009-f59302b56dee None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:54.356911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d732c-289d-4794-8009-f59302b56dee None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:54.357689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d732c-289d-4794-8009-f59302b56dee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:54.358000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d732c-289d-4794-8009-f59302b56dee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:54.359459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d732c-289d-4794-8009-f59302b56dee None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:54.372065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 623/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:54.378151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:54.487781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd248cc4-42c3-4043-be37-8492149575ee None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:54.528179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbedee3-8944-42b4-8650-2e0ad76e2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:54.529034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbedee3-8944-42b4-8650-2e0ad76e2414 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:54.529362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbedee3-8944-42b4-8650-2e0ad76e2414 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:54.529823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbedee3-8944-42b4-8650-2e0ad76e2414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:54.530707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbedee3-8944-42b4-8650-2e0ad76e2414 None admin] RBAC: Adding query filter params (role.id=fae6b286f5584beb868e5087cbf3d351, scope.project.id=8aae95f970644f279053e3f140353481, user.id=5937de29a4c04fb9ab79f5ef77b24a10) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:54.531022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbedee3-8944-42b4-8650-2e0ad76e2414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:54.532849 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbedee3-8944-42b4-8650-2e0ad76e2414 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:54.539596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 623/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:36:54 2022] GET /identity/v3/role_assignments?user.id=5937de29a4c04fb9ab79f5ef77b24a10&scope.project.id=8aae95f970644f279053e3f140353481&role.id=fae6b286f5584beb868e5087cbf3d351 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:56.966284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12948d1e-44d4-4b81-9d13-a3a9ba64b24e None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:56.966839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12948d1e-44d4-4b81-9d13-a3a9ba64b24e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:56.966995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12948d1e-44d4-4b81-9d13-a3a9ba64b24e None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:56.968547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 624/1247] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:36:56.974465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bbbf-a365-455d-92f4-f492c9bea53d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:56.975002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bbbf-a365-455d-92f4-f492c9bea53d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:56.975126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bbbf-a365-455d-92f4-f492c9bea53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:56.980794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:56.994296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b757bbbf-a365-455d-92f4-f492c9bea53d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:36:56.995658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b757bbbf-a365-455d-92f4-f492c9bea53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:36:57.077073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 624/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:36:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:36:57.104743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12948d1e-44d4-4b81-9d13-a3a9ba64b24e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:57.124289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:57.217674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12948d1e-44d4-4b81-9d13-a3a9ba64b24e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:57.259388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:57.260333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:57.260536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:57.260806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:57.273689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:36:57.282652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:57.283891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:57.284789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 625/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:57.290448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757bbbf-a365-455d-92f4-f492c9bea53d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:57.406740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757bbbf-a365-455d-92f4-f492c9bea53d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:57.448205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:57.454595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:57.455394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:57.455740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:57.456060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:57.456896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:57.457276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:57.458705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:57.471316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 625/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:57.474537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:57.572671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:57.599854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379f19-7a92-4e4f-b8ed-e89552651ff8 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:57.638554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:57.639362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:57.639678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:57.639958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:57.653352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:57.654802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:57.679517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:57.680703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:57.686372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:57.686372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:57.686372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:57.686372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:57.686372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 626/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:57.687077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:57.805185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8af94-5926-4e17-b488-0f2d4a38b99d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:57.850766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:57.852147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:57.852438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:57.852757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:57.853527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:57.853838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:57.855253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:57.870128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 626/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:57.876330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:57.989053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c7f38-8ef8-40b9-a2cb-e700673e0f8d None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:58.020025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:58.029909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:58.030819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:58.031188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:58.031495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:58.040251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:58.041696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:36:58.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:58.058533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:36:58.059754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 627/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:58.064896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:58.129820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:58.176233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860540e-3c55-41cc-aa68-3c53e2b328cc None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:58.218989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:58.219796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:58.220165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:58.220471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:58.221459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:58.221831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:58.225788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:58.247580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 627/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 23 13:36:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:36:58.254126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:58.368938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a75b0-8482-437b-8e75-232a3a6c1242 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:58.404081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:58.404842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:58.405133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:58.405414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:58.470230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:58.484444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:58.485907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:58.590881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 628/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:36:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:36:58.596874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:58.698703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d7d0b-17e0-479e-9cde-a320844122a6 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:58.711922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:58.736924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:58.737773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:58.738098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:58.738366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:58.750037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:58.751569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:36:58.771276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:58.772404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:58.773334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:36:58.773334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:36:58.773334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:36:58.773334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:58.777256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 628/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:58.778273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:58.867906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:58.881519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9dd7c-b5c8-42de-85d6-a4e8332f52cf None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:58.920268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:58.921012 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:58.921357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:58.921635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:58.922493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:58.922801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:58.924191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:58.936111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 629/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:58.942744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:59.054075 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b44f8d-20b0-44ff-9b7a-76b81527abed None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:59.099585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:59.100545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:59.100884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:59.101652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:59.109613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:59.111087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:36:59.126022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:36:59.127428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:36:59.128482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 629/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:36:59.133335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:59.251493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3c15-36bc-4321-a783-956f20f5e5aa None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:59.295904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5f798-15bc-44ad-b9f3-91dc88ce9859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:59.296431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5f798-15bc-44ad-b9f3-91dc88ce9859 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:59.296714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5f798-15bc-44ad-b9f3-91dc88ce9859 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:59.296994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5f798-15bc-44ad-b9f3-91dc88ce9859 None admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:59.297780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5f798-15bc-44ad-b9f3-91dc88ce9859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:59.298093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5f798-15bc-44ad-b9f3-91dc88ce9859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:59.299564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5f798-15bc-44ad-b9f3-91dc88ce9859 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:59.312714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 630/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:36:59.318958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:36:59.347247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:36:59.439011 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153cca-8592-4a8c-a799-895dfa0ad627 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:36:59.476106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74061c-20a2-41dd-a08c-1c949675f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:36:59.476777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74061c-20a2-41dd-a08c-1c949675f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:36:59.477060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74061c-20a2-41dd-a08c-1c949675f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:36:59.477337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74061c-20a2-41dd-a08c-1c949675f4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:36:59.478180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74061c-20a2-41dd-a08c-1c949675f4d8 None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=8aae95f970644f279053e3f140353481, user.id=5937de29a4c04fb9ab79f5ef77b24a10) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:36:59.478495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74061c-20a2-41dd-a08c-1c949675f4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:36:59.480081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74061c-20a2-41dd-a08c-1c949675f4d8 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:36:59.487504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 630/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:36:59 2022] GET /identity/v3/role_assignments?user.id=5937de29a4c04fb9ab79f5ef77b24a10&scope.project.id=8aae95f970644f279053e3f140353481&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:01.556740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944cd89-4ccc-4921-b02c-0359e55410d4 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:01.557209 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944cd89-4ccc-4921-b02c-0359e55410d4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:01.557306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944cd89-4ccc-4921-b02c-0359e55410d4 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:01.558671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 631/1261] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:01.563835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9d466-6408-4b3a-8b2f-c07c2f0df347 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:01.564243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9d466-6408-4b3a-8b2f-c07c2f0df347 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:01.564392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9d466-6408-4b3a-8b2f-c07c2f0df347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:01.580599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-eaa9d466-6408-4b3a-8b2f-c07c2f0df347 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:01.581763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-eaa9d466-6408-4b3a-8b2f-c07c2f0df347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:01.646540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 631/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:37:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:37:01.669049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944cd89-4ccc-4921-b02c-0359e55410d4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:01.679661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:01.767789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944cd89-4ccc-4921-b02c-0359e55410d4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:01.799936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:01.800704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:01.800985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:01.801254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:01.810936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:37:01.818317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:01.819910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:37:01.821130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 632/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:01.825816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9d466-6408-4b3a-8b2f-c07c2f0df347 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:01.843779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:01.921613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9d466-6408-4b3a-8b2f-c07c2f0df347 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:01.953998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:01.954668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:01.954957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:01.955267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:01.956013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:01.956324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:01.957698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:01.966045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 632/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:01.971524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:02.035364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:02.068235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dcb4f-2e5f-4509-b447-ff98a88d0bb4 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:02.100353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:02.101137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:02.101425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:02.101707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:02.111922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:02.113363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:37:02.130324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:02.131367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:02.133188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:37:02.133188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:37:02.133188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:02.133188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:37:02.133188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 633/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:02.137567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:02.214805 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:02.233781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ca588-af12-455b-925a-339f04bdd8cb None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:02.270054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:02.270723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:02.271080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:02.271323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:02.272048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:02.272358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:02.273755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:02.285856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 633/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:02.291514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:02.388409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d70ae-0045-4cf9-9427-370aae6b8349 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:02.407166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:02.421469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:02.422254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:02.422542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:02.422821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:02.430575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:02.432035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:37:02.446257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:02.447386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:37:02.448743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 634/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:37:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:02.453025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:02.549069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafc64d-6a1b-46a6-afc1-50a36d20085b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:02.581546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:02.582208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:02.582496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:02.582777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:02.583633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:02.583949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:02.585968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:02.594268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:02.602783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 634/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 23 13:37:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:02.608273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:02.712157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995edaf8-bf8a-45ba-84ab-03b267df5a96 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:02.744458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:02.745235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:02.745521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:02.745800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:02.755984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:02.758046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:37:02.774857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:02.775948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:02.777073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:37:02.777073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:37:02.777073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:02.777073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:37:02.777073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 635/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:02.781802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:02.877271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff288a-b37c-43e1-82a6-b6c677ea0be9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:02.909991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:02.910638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:02.910926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:02.911233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:02.911956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:02.912268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:02.913666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:02.924717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 635/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:02.930667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:02.962304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:03.028329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca0000-0cf9-42bf-91df-f40399319a68 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:03.059738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:03.060503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:03.060786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:03.061063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:03.067536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:03.068947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:37:03.082965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:03.084065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:37:03.085172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 636/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:03.089709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:03.153762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:03.194986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9c493-6048-46de-94b7-7dd6a1f2e076 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:03.227218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea030860-4fae-43e4-be3c-3b9942d7482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:03.227945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030860-4fae-43e4-be3c-3b9942d7482b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:03.228257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030860-4fae-43e4-be3c-3b9942d7482b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:03.228640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030860-4fae-43e4-be3c-3b9942d7482b None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:03.229535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030860-4fae-43e4-be3c-3b9942d7482b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:03.229910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030860-4fae-43e4-be3c-3b9942d7482b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:03.231646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030860-4fae-43e4-be3c-3b9942d7482b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:03.244866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 636/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:03.251127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:03.342180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:03.351317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153481-9c97-4c0d-806e-6d9b6d1efb9e None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:03.383962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd5475-d6d5-4ea4-a9b2-7130e2e25385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:03.384836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd5475-d6d5-4ea4-a9b2-7130e2e25385 None admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:03.385125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd5475-d6d5-4ea4-a9b2-7130e2e25385 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:03.385407 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd5475-d6d5-4ea4-a9b2-7130e2e25385 None admin] PATH_INFO: `/v3/projects/8aae95f970644f279053e3f140353481/users/5937de29a4c04fb9ab79f5ef77b24a10/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:03.387354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd5475-d6d5-4ea4-a9b2-7130e2e25385 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aae95f970644f279053e3f140353481, user_id=5937de29a4c04fb9ab79f5ef77b24a10, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:03.388792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd5475-d6d5-4ea4-a9b2-7130e2e25385 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:03.400794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 637/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 23 13:37:03 2022] PUT /identity/v3/projects/8aae95f970644f279053e3f140353481/users/5937de29a4c04fb9ab79f5ef77b24a10/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:37:05.386570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29eb7-187d-4d13-aae0-c29ae25a909b None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:05.387101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29eb7-187d-4d13-aae0-c29ae25a909b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:05.387257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29eb7-187d-4d13-aae0-c29ae25a909b None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:05.388523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 637/1274] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:05.393787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822609e5-4124-494a-b1cc-f8a3aac5af03 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:05.394152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822609e5-4124-494a-b1cc-f8a3aac5af03 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:05.394342 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822609e5-4124-494a-b1cc-f8a3aac5af03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:05.411174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-822609e5-4124-494a-b1cc-f8a3aac5af03 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:05.412372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-822609e5-4124-494a-b1cc-f8a3aac5af03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:05.474992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 638/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:37:05.498236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e29eb7-187d-4d13-aae0-c29ae25a909b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:05.597920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e29eb7-187d-4d13-aae0-c29ae25a909b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:05.615724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:05.632683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:05.633474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:05.633757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:05.634031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:05.644052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 13:37:05.652105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:05.653198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:05.654357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 638/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 23 13:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:05.659287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822609e5-4124-494a-b1cc-f8a3aac5af03 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:05.736740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:05.755941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822609e5-4124-494a-b1cc-f8a3aac5af03 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:05.788601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:05.789255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:05.789542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:05.789823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:05.790562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:05.790960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:05.792361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:05.800150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 639/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 23 13:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:05.806126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:05.903257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056d67-9bc6-4c7d-be45-86dcff301be1 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:05.936002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:05.936780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:05.937069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:05.937347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:05.947624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:05.949089 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:37:05.966107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:05.967155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:05.968115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:37:05.968115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:37:05.968115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:05.968115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:05.968115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 639/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:05.972762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:06.068148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b88061-476e-4671-93a4-06cca5ccfc0b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:06.099997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:06.101216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:06.101507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:06.101786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:06.102497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:06.102807 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:06.104357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:06.115604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 640/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:06.120991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:06.151848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:06.218462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709bfa7-13b8-401b-8c4a-86984abfc4f9 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:06.254311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:06.255112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:06.255432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:06.255711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:06.263928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:06.265442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 13:37:06.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:06.283949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:06.285630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 640/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:37:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:06.291602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:06.296942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:06.389067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad0bb-98fe-4c42-be3b-9540b6600b0b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:06.421494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:06.422146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:06.422429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:06.422706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:06.423563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:06.423869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:06.425280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:06.441372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 641/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 23 13:37:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:06.447525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:06.535378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:06.544829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254e27-abbf-4388-8722-0157ad45497a None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:06.577417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:06.578051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:06.578337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:06.578614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:06.643430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:06.644885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:06.728535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:06.739140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 641/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 23 13:37:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 13:37:06.745373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:06.803558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:06.840839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897bba-ce74-43dc-a8d5-e8359fad225f None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:06.872790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:06.873556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:06.873839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:06.874115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:06.884321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:06.885748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 13:37:06.902715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:06.903673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:06.904585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 13:37:06.904585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 13:37:06.904585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 13:37:06.904585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:37:06.904585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 642/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 13:37:06.909445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:07.003667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da996-e805-47ae-9b2e-83796d4cdb5f None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:07.035757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:07.036399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:07.036686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:07.036966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:07.037678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:07.037990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:07.039898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:07.050578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 642/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 23 13:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:07.056559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:07.152465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a84c-1d57-494c-a2fb-920e7f80215b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:07.165621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:07.184751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:07.185524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:07.185809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:07.186083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:07.192484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:07.193907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 13:37:07.207633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:07.208649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: ERROR keystone.server.flask.application Jun 23 13:37:07.209790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 643/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 23 13:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:07.215241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:07.268687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:07.316034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccd55-148d-4559-bbfe-8fc02e0c5e58 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:07.348154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0f0f-89b4-4baf-88d0-03da6c4adfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:07.348804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0f0f-89b4-4baf-88d0-03da6c4adfee None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:07.349091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0f0f-89b4-4baf-88d0-03da6c4adfee None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:07.349370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0f0f-89b4-4baf-88d0-03da6c4adfee None admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:07.350148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0f0f-89b4-4baf-88d0-03da6c4adfee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:07.350460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0f0f-89b4-4baf-88d0-03da6c4adfee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:07.351946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0f0f-89b4-4baf-88d0-03da6c4adfee None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:07.363442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 643/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 23 13:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:07.370087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:07.466601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2d1bf-4727-430e-b634-adbf5d9f2f22 None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:07.499220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdfb5-d2db-4a61-86c8-5c3018589e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:07.499871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdfb5-d2db-4a61-86c8-5c3018589e4b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:07.500162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdfb5-d2db-4a61-86c8-5c3018589e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:07.500444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdfb5-d2db-4a61-86c8-5c3018589e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:07.501267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdfb5-d2db-4a61-86c8-5c3018589e4b None admin] RBAC: Adding query filter params (role.id=eb12d27128ad4920b71e88bc6a0a8257, scope.project.id=8aae95f970644f279053e3f140353481, user.id=5937de29a4c04fb9ab79f5ef77b24a10) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:07.501582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdfb5-d2db-4a61-86c8-5c3018589e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:07.503002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdfb5-d2db-4a61-86c8-5c3018589e4b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:07.509310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 644/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 23 13:37:07 2022] GET /identity/v3/role_assignments?user.id=5937de29a4c04fb9ab79f5ef77b24a10&scope.project.id=8aae95f970644f279053e3f140353481&role.id=eb12d27128ad4920b71e88bc6a0a8257 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:09.520533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073bed9-dedf-4b63-bc92-fd200d8cc7c2 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:09.520953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073bed9-dedf-4b63-bc92-fd200d8cc7c2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:09.521088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073bed9-dedf-4b63-bc92-fd200d8cc7c2 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:09.522949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 644/1288] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:09.528060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af8d6b-0f01-468d-b916-e09562e37856 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:09.528476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af8d6b-0f01-468d-b916-e09562e37856 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:09.528632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af8d6b-0f01-468d-b916-e09562e37856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:09.545567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-85af8d6b-0f01-468d-b916-e09562e37856 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:09.546735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-85af8d6b-0f01-468d-b916-e09562e37856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:09.574810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:09.611913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 645/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:37:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:37:09.633326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073bed9-dedf-4b63-bc92-fd200d8cc7c2 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:09.731921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073bed9-dedf-4b63-bc92-fd200d8cc7c2 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:09.742303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:09.765141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:09.765931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:09.766216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:09.766493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] PATH_INFO: `/v3/services/placement` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:09.767435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:09.768808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:09.780819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:09.782005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:09.783072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 645/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:37:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:09.787855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af8d6b-0f01-468d-b916-e09562e37856 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:09.882624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af8d6b-0f01-468d-b916-e09562e37856 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:09.914995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb272-1f4f-43bd-b990-11e514283203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:09.915664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb272-1f4f-43bd-b990-11e514283203 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:09.915949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb272-1f4f-43bd-b990-11e514283203 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:09.916225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb272-1f4f-43bd-b990-11e514283203 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:09.916914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb272-1f4f-43bd-b990-11e514283203 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:09.917223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb272-1f4f-43bd-b990-11e514283203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:09.918572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb272-1f4f-43bd-b990-11e514283203 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:09.923192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 646/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 23 13:37:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:09.928583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:10.025134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019fa3-f138-404a-a13e-43d56ff77c2d None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:10.056552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5ccd6-c531-4bd4-9424-3a128bd622e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:10.057185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5ccd6-c531-4bd4-9424-3a128bd622e3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:10.057475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5ccd6-c531-4bd4-9424-3a128bd622e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:10.057751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5ccd6-c531-4bd4-9424-3a128bd622e3 None admin] PATH_INFO: `/v3/services` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:10.058439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5ccd6-c531-4bd4-9424-3a128bd622e3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:10.058745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5ccd6-c531-4bd4-9424-3a128bd622e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:10.060119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5ccd6-c531-4bd4-9424-3a128bd622e3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:10.064358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 646/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 23 13:37:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:12.119196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07e746-d97f-403f-9720-cdf088b558b1 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:12.119822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07e746-d97f-403f-9720-cdf088b558b1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:12.119822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07e746-d97f-403f-9720-cdf088b558b1 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:12.122149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 647/1293] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:12.127167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905d1d4-de09-4b9e-b659-b7bfd6ed8be9 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:12.127620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905d1d4-de09-4b9e-b659-b7bfd6ed8be9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:12.127781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905d1d4-de09-4b9e-b659-b7bfd6ed8be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:12.145641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7905d1d4-de09-4b9e-b659-b7bfd6ed8be9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:12.146827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7905d1d4-de09-4b9e-b659-b7bfd6ed8be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:12.175394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:12.211728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 647/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:37:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:37:12.236759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07e746-d97f-403f-9720-cdf088b558b1 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:12.271150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:12.345378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07e746-d97f-403f-9720-cdf088b558b1 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:12.378448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976aa62-0f92-4cf8-a06e-7f8ec6c8da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:12.379047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976aa62-0f92-4cf8-a06e-7f8ec6c8da67 None admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:12.379366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976aa62-0f92-4cf8-a06e-7f8ec6c8da67 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:12.379655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976aa62-0f92-4cf8-a06e-7f8ec6c8da67 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:12.380379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976aa62-0f92-4cf8-a06e-7f8ec6c8da67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:12.381768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976aa62-0f92-4cf8-a06e-7f8ec6c8da67 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:12.394273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 648/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 23 13:37:12 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:37:14.433380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006228-4fce-46be-b86b-453976af86cf None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:14.433946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006228-4fce-46be-b86b-453976af86cf None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:14.433946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006228-4fce-46be-b86b-453976af86cf None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:14.435349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 648/1296] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:14.440321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f286ed5-6e86-414e-bb53-2d8919a3261d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:14.440753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f286ed5-6e86-414e-bb53-2d8919a3261d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:14.440881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f286ed5-6e86-414e-bb53-2d8919a3261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:14.457888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-7f286ed5-6e86-414e-bb53-2d8919a3261d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:14.459057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7f286ed5-6e86-414e-bb53-2d8919a3261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:14.530371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 649/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:37:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 13:37:14.553451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006228-4fce-46be-b86b-453976af86cf None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:14.651417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006228-4fce-46be-b86b-453976af86cf None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:14.683466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:14.684192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:14.684484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:14.684761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:14.685411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:14.686796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:14.698845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:14.700119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:14.701406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 649/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:37:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:14.706025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f286ed5-6e86-414e-bb53-2d8919a3261d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:14.724051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:14.808981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f286ed5-6e86-414e-bb53-2d8919a3261d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:14.841649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:14.842303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:14.842585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:14.842861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:14.843606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] RBAC: Adding query filter params (name=placement) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:14.843917 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:14.845273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:14.850273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 650/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 23 13:37:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:14.856697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:14.887830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:14.954036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98542d15-ef53-47f7-a78d-02f80d764363 None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:14.985500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677f4fe-8e9c-4f42-8f28-e32f923dfaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:14.986145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f4fe-8e9c-4f42-8f28-e32f923dfaa3 None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:14.986432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f4fe-8e9c-4f42-8f28-e32f923dfaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:14.986713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677f4fe-8e9c-4f42-8f28-e32f923dfaa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:14.987524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677f4fe-8e9c-4f42-8f28-e32f923dfaa3 None admin] RBAC: Adding query filter params (interface=public, service_id=6a792fa2ea5046ac9910026f7ba3e860, region_id=RegionOne) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:14.987840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677f4fe-8e9c-4f42-8f28-e32f923dfaa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:14.989197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677f4fe-8e9c-4f42-8f28-e32f923dfaa3 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:14.994545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 650/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 23 13:37:14 2022] GET /identity/v3/endpoints?service_id=6a792fa2ea5046ac9910026f7ba3e860&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:37:14.999913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:15.078033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:15.098279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cfa81-be82-48db-987b-02d19721da0b None admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:15.135032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8d3f8-5454-4c17-a75b-2b0b50395e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:15.135714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8d3f8-5454-4c17-a75b-2b0b50395e2d None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:15.136115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8d3f8-5454-4c17-a75b-2b0b50395e2d None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:15.136393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8d3f8-5454-4c17-a75b-2b0b50395e2d None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:15.137096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8d3f8-5454-4c17-a75b-2b0b50395e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:15.138447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8d3f8-5454-4c17-a75b-2b0b50395e2d None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:15.145698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 651/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 23 13:37:14 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:37:17.136666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55fc34-663d-4ae6-b970-1190d9e56479 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.137213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55fc34-663d-4ae6-b970-1190d9e56479 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.137213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55fc34-663d-4ae6-b970-1190d9e56479 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.138570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 651/1302] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:37:17.143963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72a6f1-3d0b-45d4-8bbf-c67c558376af None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.144355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72a6f1-3d0b-45d4-8bbf-c67c558376af None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.144521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72a6f1-3d0b-45d4-8bbf-c67c558376af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.160717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-dc72a6f1-3d0b-45d4-8bbf-c67c558376af None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:37:17.161880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-dc72a6f1-3d0b-45d4-8bbf-c67c558376af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:37:17.227245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 652/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:37:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 13:37:17.252685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55fc34-663d-4ae6-b970-1190d9e56479 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:17.351958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:17.358814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55fc34-663d-4ae6-b970-1190d9e56479 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:17.390921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:17.391679 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.391969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.392496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] PATH_INFO: `/v3/services/placement` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.393143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:17.394510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 13:37:17.406620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 13:37:17.407830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application with Lock( Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self._enter() Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application return self.creator() Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application created_value = creator( Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: ERROR keystone.server.flask.application Jun 23 13:37:17.408896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 652/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 23 13:37:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 13:37:17.413702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72a6f1-3d0b-45d4-8bbf-c67c558376af None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:17.487871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:17.510499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72a6f1-3d0b-45d4-8bbf-c67c558376af None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:17.542928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55380ff-64c0-4a2a-bf27-9f7ae7d68562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:17.543609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55380ff-64c0-4a2a-bf27-9f7ae7d68562 None admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.543893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55380ff-64c0-4a2a-bf27-9f7ae7d68562 None admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.544173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55380ff-64c0-4a2a-bf27-9f7ae7d68562 None admin] PATH_INFO: `/v3/services` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.544867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55380ff-64c0-4a2a-bf27-9f7ae7d68562 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:37:17.545174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55380ff-64c0-4a2a-bf27-9f7ae7d68562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:17.546524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55380ff-64c0-4a2a-bf27-9f7ae7d68562 None admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:17.551519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 653/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 23 13:37:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:37:17.557306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:37:17.654035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a545-3af4-429f-bdb5-f510b5e3a07b None admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:37:17.685608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd95a32-636c-4034-a8eb-aa6f82601928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:37:17.686251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95a32-636c-4034-a8eb-aa6f82601928 None admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:37:17.686537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95a32-636c-4034-a8eb-aa6f82601928 None admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:37:17.686818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95a32-636c-4034-a8eb-aa6f82601928 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:37:17.687576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd95a32-636c-4034-a8eb-aa6f82601928 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:37:17.688945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd95a32-636c-4034-a8eb-aa6f82601928 None admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:37:17.707477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 653/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 23 13:37:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:37:27.548966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=30 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:27.703695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:19.756873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81a52c-1a72-40e0-9ae6-bbfdd650142c None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.757401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81a52c-1a72-40e0-9ae6-bbfdd650142c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.757401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81a52c-1a72-40e0-9ae6-bbfdd650142c None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.763910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed739d-4e03-46c5-a861-9bba8ba45118 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:19.764343 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed739d-4e03-46c5-a861-9bba8ba45118 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:19.764518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed739d-4e03-46c5-a861-9bba8ba45118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:19.768268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 654/1307] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:19.893453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-95ed739d-4e03-46c5-a861-9bba8ba45118 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:19.895516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-95ed739d-4e03-46c5-a861-9bba8ba45118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:20.108300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 654/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:38:20.149634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a4d55-9377-4b39-b059-e9337e2fe00c None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.150083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a4d55-9377-4b39-b059-e9337e2fe00c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.150462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a4d55-9377-4b39-b059-e9337e2fe00c None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.152022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 655/1309] 10.222.0.23 () {54 vars in 964 bytes} [Thu Jun 23 13:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:20.158702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4436f-333d-4420-8ea2-7eb574f0c567 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.159128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4436f-333d-4420-8ea2-7eb574f0c567 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.159537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4436f-333d-4420-8ea2-7eb574f0c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.238039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4de4436f-333d-4420-8ea2-7eb574f0c567 None None] MFA Rules not processed for user `45c718c1e1024d73b6b635f77bacdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:20.240143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4de4436f-333d-4420-8ea2-7eb574f0c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:20.263486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:20.324251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 655/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Jun 23 13:38:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:20.333521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a4d55-9377-4b39-b059-e9337e2fe00c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:20.335559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-907a4d55-9377-4b39-b059-e9337e2fe00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:20.462432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a4d55-9377-4b39-b059-e9337e2fe00c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:20.541189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc9381-e31f-45b6-82ec-c7dc441780a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:20.542100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc9381-e31f-45b6-82ec-c7dc441780a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:20.542533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc9381-e31f-45b6-82ec-c7dc441780a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:20.542955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc9381-e31f-45b6-82ec-c7dc441780a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:20.544755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b7cc9381-e31f-45b6-82ec-c7dc441780a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:20.601916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:20.669893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc9381-e31f-45b6-82ec-c7dc441780a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:20.671628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc9381-e31f-45b6-82ec-c7dc441780a4 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:20.696804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 656/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:23.084057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2fe9f-a99f-41dc-b3f7-e20c246ebe78 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:23.084606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2fe9f-a99f-41dc-b3f7-e20c246ebe78 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:23.084606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2fe9f-a99f-41dc-b3f7-e20c246ebe78 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:23.086007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 656/1312] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:23.091331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97831c7-3457-47e5-bab9-3827468859ba None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:23.091762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97831c7-3457-47e5-bab9-3827468859ba None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:23.092024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97831c7-3457-47e5-bab9-3827468859ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:23.173577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f97831c7-3457-47e5-bab9-3827468859ba None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:23.174775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f97831c7-3457-47e5-bab9-3827468859ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:23.282356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 657/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:23.320695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2fe9f-a99f-41dc-b3f7-e20c246ebe78 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:23.322279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c1e2fe9f-a99f-41dc-b3f7-e20c246ebe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:23.433698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2fe9f-a99f-41dc-b3f7-e20c246ebe78 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:23.517816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:23.520233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04264-cdf0-4172-9c61-40d5f636a714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:23.522032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04264-cdf0-4172-9c61-40d5f636a714 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:23.522329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04264-cdf0-4172-9c61-40d5f636a714 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:23.522821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04264-cdf0-4172-9c61-40d5f636a714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:23.524734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-90d04264-cdf0-4172-9c61-40d5f636a714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:23.633734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04264-cdf0-4172-9c61-40d5f636a714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:23.635194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04264-cdf0-4172-9c61-40d5f636a714 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:23.656151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 657/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:25.965501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643bf6-863a-45f5-abfc-75efffd565b0 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:25.966053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643bf6-863a-45f5-abfc-75efffd565b0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:25.966053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643bf6-863a-45f5-abfc-75efffd565b0 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:25.967476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 658/1315] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:25.972496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e13de-22e6-463c-a8ae-c7cab08ab6a8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:25.972931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e13de-22e6-463c-a8ae-c7cab08ab6a8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:25.973052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e13de-22e6-463c-a8ae-c7cab08ab6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:26.035488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-601e13de-22e6-463c-a8ae-c7cab08ab6a8 None None] MFA Rules not processed for user `9cff92b0e6704fd3bfafffcd292f8e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:26.037205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-601e13de-22e6-463c-a8ae-c7cab08ab6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:26.085977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:26.130224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 658/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:38:26.170549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643bf6-863a-45f5-abfc-75efffd565b0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:26.172113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-45643bf6-863a-45f5-abfc-75efffd565b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:26.181801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:26.274152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643bf6-863a-45f5-abfc-75efffd565b0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:26.344533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35d74a-2d15-4184-a242-d888e696ecb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:26.345175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35d74a-2d15-4184-a242-d888e696ecb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:26.345462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35d74a-2d15-4184-a242-d888e696ecb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:26.345742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35d74a-2d15-4184-a242-d888e696ecb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:26.347398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bf35d74a-2d15-4184-a242-d888e696ecb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:26.408487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:26.453621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35d74a-2d15-4184-a242-d888e696ecb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:26.455073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35d74a-2d15-4184-a242-d888e696ecb3 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:26.473705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 659/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:29.058527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab46f54-a21b-4e20-86ee-a63458bee0a5 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:29.059090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab46f54-a21b-4e20-86ee-a63458bee0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:29.059090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab46f54-a21b-4e20-86ee-a63458bee0a5 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:29.060488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 659/1318] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:29.065649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3abd8-4de1-4bfb-910f-15efefbd5c63 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:29.066054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3abd8-4de1-4bfb-910f-15efefbd5c63 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:29.066210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3abd8-4de1-4bfb-910f-15efefbd5c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:29.128600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d1e3abd8-4de1-4bfb-910f-15efefbd5c63 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:29.129792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d1e3abd8-4de1-4bfb-910f-15efefbd5c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:29.225356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 660/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:29.276605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880903-6fe9-424d-b987-efdd0a872507 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:29.276893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880903-6fe9-424d-b987-efdd0a872507 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:29.277172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880903-6fe9-424d-b987-efdd0a872507 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:29.278549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 660/1320] 10.222.0.23 () {54 vars in 964 bytes} [Thu Jun 23 13:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:29.284214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523dc8b-5eac-4cb1-a326-4afa72135bf3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:29.284505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523dc8b-5eac-4cb1-a326-4afa72135bf3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:29.284784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523dc8b-5eac-4cb1-a326-4afa72135bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:29.305388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:29.358513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1523dc8b-5eac-4cb1-a326-4afa72135bf3 None None] MFA Rules not processed for user `45c718c1e1024d73b6b635f77bacdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:29.359730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1523dc8b-5eac-4cb1-a326-4afa72135bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:29.433423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 661/1321] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Jun 23 13:38:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:29.442898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880903-6fe9-424d-b987-efdd0a872507 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:29.444454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-68880903-6fe9-424d-b987-efdd0a872507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:29.545077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880903-6fe9-424d-b987-efdd0a872507 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:29.615844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3719e-3b21-4f7f-83dc-1531e72e2efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:29.616422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3719e-3b21-4f7f-83dc-1531e72e2efb service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:29.616703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3719e-3b21-4f7f-83dc-1531e72e2efb service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:29.616975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3719e-3b21-4f7f-83dc-1531e72e2efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:29.618582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-61a3719e-3b21-4f7f-83dc-1531e72e2efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:29.625684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:29.725462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3719e-3b21-4f7f-83dc-1531e72e2efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:29.726927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3719e-3b21-4f7f-83dc-1531e72e2efb service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:29.744718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 661/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:32.866076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd256-f2d4-43e3-bec7-37eedf4af887 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:32.866612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd256-f2d4-43e3-bec7-37eedf4af887 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:32.866703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd256-f2d4-43e3-bec7-37eedf4af887 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:32.868057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 662/1323] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:32.873300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b93df-f9a1-45c1-bea2-487b68e2f2d3 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:32.873729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b93df-f9a1-45c1-bea2-487b68e2f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:32.873866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b93df-f9a1-45c1-bea2-487b68e2f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:32.940262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f52b93df-f9a1-45c1-bea2-487b68e2f2d3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:32.941461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f52b93df-f9a1-45c1-bea2-487b68e2f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:33.003237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:33.046974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 662/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:33.083948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cd256-f2d4-43e3-bec7-37eedf4af887 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:33.085582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-387cd256-f2d4-43e3-bec7-37eedf4af887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:33.195325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cd256-f2d4-43e3-bec7-37eedf4af887 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:33.207394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:33.270185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e1290-d6bd-4a83-b0f6-75a9fc504cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:33.270842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1290-d6bd-4a83-b0f6-75a9fc504cdf service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:33.271130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1290-d6bd-4a83-b0f6-75a9fc504cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:33.271438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1290-d6bd-4a83-b0f6-75a9fc504cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:33.273097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cd7e1290-d6bd-4a83-b0f6-75a9fc504cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:33.381158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1290-d6bd-4a83-b0f6-75a9fc504cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:33.382655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1290-d6bd-4a83-b0f6-75a9fc504cdf service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:33.400742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 663/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:35.497705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c66150-7180-4a13-8c34-1f1d71925373 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:35.498155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c66150-7180-4a13-8c34-1f1d71925373 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:35.498251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c66150-7180-4a13-8c34-1f1d71925373 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:35.499656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 663/1326] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:35.504738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14d0a-483c-4d64-84eb-0905ded9106b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:35.505123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14d0a-483c-4d64-84eb-0905ded9106b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:35.505332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14d0a-483c-4d64-84eb-0905ded9106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:35.554384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:35.573421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-19c14d0a-483c-4d64-84eb-0905ded9106b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:35.574658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-19c14d0a-483c-4d64-84eb-0905ded9106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:35.671346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 664/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:35.708141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c66150-7180-4a13-8c34-1f1d71925373 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:35.709692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-71c66150-7180-4a13-8c34-1f1d71925373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:35.812487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c66150-7180-4a13-8c34-1f1d71925373 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:35.887557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175cd44-b608-4790-a5f1-d6ddaf8123f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:35.888220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175cd44-b608-4790-a5f1-d6ddaf8123f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:35.888504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175cd44-b608-4790-a5f1-d6ddaf8123f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:35.888780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175cd44-b608-4790-a5f1-d6ddaf8123f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:35.890503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1175cd44-b608-4790-a5f1-d6ddaf8123f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:35.908554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:36.000229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175cd44-b608-4790-a5f1-d6ddaf8123f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:36.001740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175cd44-b608-4790-a5f1-d6ddaf8123f0 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:36.019573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 664/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:38.076318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20797af-bd50-4cb4-8eab-19be940dccc0 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:38.076841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20797af-bd50-4cb4-8eab-19be940dccc0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:38.076932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20797af-bd50-4cb4-8eab-19be940dccc0 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:38.078374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 665/1329] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:38.083505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f457-33e8-4f30-a3f6-66858a3a2732 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:38.083939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f457-33e8-4f30-a3f6-66858a3a2732 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:38.084067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f457-33e8-4f30-a3f6-66858a3a2732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:38.148548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1b56f457-33e8-4f30-a3f6-66858a3a2732 None None] MFA Rules not processed for user `9cff92b0e6704fd3bfafffcd292f8e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:38.149771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1b56f457-33e8-4f30-a3f6-66858a3a2732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:38.216907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:38.251877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 665/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:38.289936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20797af-bd50-4cb4-8eab-19be940dccc0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:38.291598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d20797af-bd50-4cb4-8eab-19be940dccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:38.411290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20797af-bd50-4cb4-8eab-19be940dccc0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:38.436725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:38.493215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c2be5-c1ac-43d1-a0a1-e2d383038992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:38.493870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2be5-c1ac-43d1-a0a1-e2d383038992 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:38.494158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2be5-c1ac-43d1-a0a1-e2d383038992 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:38.494438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2be5-c1ac-43d1-a0a1-e2d383038992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:38.496097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cf4c2be5-c1ac-43d1-a0a1-e2d383038992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:38.603288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c2be5-c1ac-43d1-a0a1-e2d383038992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:38.604780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c2be5-c1ac-43d1-a0a1-e2d383038992 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:38.637948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 666/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:40.912626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acda61-4545-41d0-b554-3361c476368d None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:40.913178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acda61-4545-41d0-b554-3361c476368d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:40.913178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acda61-4545-41d0-b554-3361c476368d None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:40.914576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 666/1332] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:40.919812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461db3-db13-4ad3-b797-66270fa3ea95 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:40.920188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461db3-db13-4ad3-b797-66270fa3ea95 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:40.920383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461db3-db13-4ad3-b797-66270fa3ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:40.981491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:40.984322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-45461db3-db13-4ad3-b797-66270fa3ea95 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:40.986045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-45461db3-db13-4ad3-b797-66270fa3ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:41.082405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 667/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:41.118099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acda61-4545-41d0-b554-3361c476368d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:41.119670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-16acda61-4545-41d0-b554-3361c476368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:41.219670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acda61-4545-41d0-b554-3361c476368d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:41.292378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bb873-8003-4846-b241-e64a428085b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:41.293017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb873-8003-4846-b241-e64a428085b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:41.293301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb873-8003-4846-b241-e64a428085b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:41.293577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb873-8003-4846-b241-e64a428085b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:41.295190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c68bb873-8003-4846-b241-e64a428085b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:41.322196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:41.402767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bb873-8003-4846-b241-e64a428085b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:41.404162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bb873-8003-4846-b241-e64a428085b0 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:41.421883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 667/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:43.464127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab575-8fed-42a5-87db-2f1ca106396c None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:43.464765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab575-8fed-42a5-87db-2f1ca106396c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:43.464765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab575-8fed-42a5-87db-2f1ca106396c None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:43.466041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 668/1335] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:43.471379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb123e-fcd1-449a-a4bc-0aece5feb80c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:43.471794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb123e-fcd1-449a-a4bc-0aece5feb80c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:43.471946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb123e-fcd1-449a-a4bc-0aece5feb80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:43.534689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-45fb123e-fcd1-449a-a4bc-0aece5feb80c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:43.535898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-45fb123e-fcd1-449a-a4bc-0aece5feb80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:43.609827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:43.632622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 668/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:43.672503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab575-8fed-42a5-87db-2f1ca106396c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:43.674038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e2cab575-8fed-42a5-87db-2f1ca106396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:43.777649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab575-8fed-42a5-87db-2f1ca106396c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:43.805936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:43.851750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb1cd-6543-4b2f-b460-979a2a6721b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:43.852400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb1cd-6543-4b2f-b460-979a2a6721b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:43.852685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb1cd-6543-4b2f-b460-979a2a6721b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:43.852962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb1cd-6543-4b2f-b460-979a2a6721b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:43.854587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4efdb1cd-6543-4b2f-b460-979a2a6721b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:43.960374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb1cd-6543-4b2f-b460-979a2a6721b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:43.961823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb1cd-6543-4b2f-b460-979a2a6721b0 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:43.979743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 669/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:46.393260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304397-4dcb-40e2-8a27-df7396f81885 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:46.393795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304397-4dcb-40e2-8a27-df7396f81885 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:46.393913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304397-4dcb-40e2-8a27-df7396f81885 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:46.395253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 669/1338] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:46.400421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f398fb-3031-4fa1-9c0b-01ef3fe3f865 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:46.400826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f398fb-3031-4fa1-9c0b-01ef3fe3f865 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:46.401016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f398fb-3031-4fa1-9c0b-01ef3fe3f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:46.464446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-36f398fb-3031-4fa1-9c0b-01ef3fe3f865 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:46.465655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-36f398fb-3031-4fa1-9c0b-01ef3fe3f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:46.474020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:46.561429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 670/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:46.597174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304397-4dcb-40e2-8a27-df7396f81885 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:46.598673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a9304397-4dcb-40e2-8a27-df7396f81885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:46.699832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304397-4dcb-40e2-8a27-df7396f81885 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:46.774642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37544f-a5bd-412d-b48c-ed8c2cf67e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:46.775329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37544f-a5bd-412d-b48c-ed8c2cf67e28 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:46.775617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37544f-a5bd-412d-b48c-ed8c2cf67e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:46.775919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37544f-a5bd-412d-b48c-ed8c2cf67e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:46.777539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-eb37544f-a5bd-412d-b48c-ed8c2cf67e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:46.812910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:46.885416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37544f-a5bd-412d-b48c-ed8c2cf67e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:46.886853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37544f-a5bd-412d-b48c-ed8c2cf67e28 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:46.905295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 670/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:50.863793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adc6fe-a098-444f-90d9-02360c00a039 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:50.864307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adc6fe-a098-444f-90d9-02360c00a039 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:50.864307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adc6fe-a098-444f-90d9-02360c00a039 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:50.865721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 671/1341] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:50.870979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8d18-8e01-458d-a50d-8ed0d72e4b1b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:50.871540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8d18-8e01-458d-a50d-8ed0d72e4b1b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:50.871817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8d18-8e01-458d-a50d-8ed0d72e4b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:50.943071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8eed8d18-8e01-458d-a50d-8ed0d72e4b1b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:50.944338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8eed8d18-8e01-458d-a50d-8ed0d72e4b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:51.037944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:51.051301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 671/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:51.090053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adc6fe-a098-444f-90d9-02360c00a039 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:51.092183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b3adc6fe-a098-444f-90d9-02360c00a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:51.187869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adc6fe-a098-444f-90d9-02360c00a039 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:51.191502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f0fd-ff11-4cc9-aa53-bdffccff882c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:51.192242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f0fd-ff11-4cc9-aa53-bdffccff882c service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:51.192600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f0fd-ff11-4cc9-aa53-bdffccff882c service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:51.192950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f0fd-ff11-4cc9-aa53-bdffccff882c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:51.202462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f0fd-ff11-4cc9-aa53-bdffccff882c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:51.203928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f0fd-ff11-4cc9-aa53-bdffccff882c service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:51.213762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 672/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:38:53.969165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2d8c-a666-4c50-8397-33a1377db781 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:53.969754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2d8c-a666-4c50-8397-33a1377db781 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:53.969754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2d8c-a666-4c50-8397-33a1377db781 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:53.971156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 672/1344] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:53.977791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9bc86-0c7a-4c2c-92a2-e4265157821f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:53.978355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9bc86-0c7a-4c2c-92a2-e4265157821f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:53.978355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9bc86-0c7a-4c2c-92a2-e4265157821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:54.007123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-34f9bc86-0c7a-4c2c-92a2-e4265157821f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:54.008381 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-34f9bc86-0c7a-4c2c-92a2-e4265157821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:54.039599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:38:54.091151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 673/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:54.128598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2d8c-a666-4c50-8397-33a1377db781 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:54.130451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-129b2d8c-a666-4c50-8397-33a1377db781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:54.144784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2d8c-a666-4c50-8397-33a1377db781 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:54.149141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec8e53-c91a-40ed-ad69-9dcd70104424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:54.149869 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec8e53-c91a-40ed-ad69-9dcd70104424 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:54.150248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec8e53-c91a-40ed-ad69-9dcd70104424 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:54.150601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec8e53-c91a-40ed-ad69-9dcd70104424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:54.160543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec8e53-c91a-40ed-ad69-9dcd70104424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:54.162029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec8e53-c91a-40ed-ad69-9dcd70104424 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:54.172899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 673/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:38:58.076207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aca23-2fae-4626-bee6-c2faee3de92d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:58.076769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aca23-2fae-4626-bee6-c2faee3de92d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:58.076874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aca23-2fae-4626-bee6-c2faee3de92d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:58.078262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 674/1347] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:38:58.083672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047bf8e-2fb2-4bcb-81f9-edbc601aaa57 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:58.084126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047bf8e-2fb2-4bcb-81f9-edbc601aaa57 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:58.084355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047bf8e-2fb2-4bcb-81f9-edbc601aaa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:58.103088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3047bf8e-2fb2-4bcb-81f9-edbc601aaa57 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:38:58.104385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3047bf8e-2fb2-4bcb-81f9-edbc601aaa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:38:58.112311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 674/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:38:58.151011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aca23-2fae-4626-bee6-c2faee3de92d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:38:58.163386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aca23-2fae-4626-bee6-c2faee3de92d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:38:58.167474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03142b4f-73a5-4484-8d92-838de1fd1edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:38:58.168119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142b4f-73a5-4484-8d92-838de1fd1edc service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:38:58.168406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142b4f-73a5-4484-8d92-838de1fd1edc service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:38:58.168686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142b4f-73a5-4484-8d92-838de1fd1edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:38:58.178803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03142b4f-73a5-4484-8d92-838de1fd1edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:38:58.180294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03142b4f-73a5-4484-8d92-838de1fd1edc service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:38:58.189987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 675/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:03.125022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f344a-7bcc-4900-b236-4db1655c281a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:03.125950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f344a-7bcc-4900-b236-4db1655c281a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:03.126468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f344a-7bcc-4900-b236-4db1655c281a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:03.128446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 675/1350] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:03.134015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffef06-d771-4c0a-9928-e5cf0b6275a3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:03.134482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffef06-d771-4c0a-9928-e5cf0b6275a3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:03.134566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffef06-d771-4c0a-9928-e5cf0b6275a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:03.206545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6bffef06-d771-4c0a-9928-e5cf0b6275a3 None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:03.209347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6bffef06-d771-4c0a-9928-e5cf0b6275a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:03.335359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 676/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:07.540225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c421-9dc3-4f3a-a1e0-966ceec7e456 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:07.541114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c421-9dc3-4f3a-a1e0-966ceec7e456 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:07.541412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c421-9dc3-4f3a-a1e0-966ceec7e456 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:07.542991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 676/1352] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:07.548173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd966a0-1eed-456a-b3c9-4f4998e8a191 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:07.549083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd966a0-1eed-456a-b3c9-4f4998e8a191 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:07.549588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd966a0-1eed-456a-b3c9-4f4998e8a191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:07.568248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-bdd966a0-1eed-456a-b3c9-4f4998e8a191 None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:07.569422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bdd966a0-1eed-456a-b3c9-4f4998e8a191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:07.578043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 677/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:08.097273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=13 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:09.270562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24b27d-cbde-4925-9366-3e81815e1e9a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:09.271222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24b27d-cbde-4925-9366-3e81815e1e9a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:09.271222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24b27d-cbde-4925-9366-3e81815e1e9a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:09.272636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 677/1354] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:09.277556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731250-41bd-444f-a411-b97f7d7d1b69 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:09.277985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731250-41bd-444f-a411-b97f7d7d1b69 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:09.278203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731250-41bd-444f-a411-b97f7d7d1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:09.296599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-13731250-41bd-444f-a411-b97f7d7d1b69 None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:09.297791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-13731250-41bd-444f-a411-b97f7d7d1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:09.306911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 678/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:39:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.821162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e383-241d-42dd-9343-e7099a5a548b None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.821714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e383-241d-42dd-9343-e7099a5a548b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.821714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e383-241d-42dd-9343-e7099a5a548b None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.826857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 678/1356] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:12.832789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4eed-f235-4af3-a67a-a3953bf5a890 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.833288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4eed-f235-4af3-a67a-a3953bf5a890 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.833440 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4eed-f235-4af3-a67a-a3953bf5a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.851736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e2ca4eed-f235-4af3-a67a-a3953bf5a890 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.852936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e2ca4eed-f235-4af3-a67a-a3953bf5a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:12.861222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 679/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:12.918375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2c00-a97e-4edb-a018-d99b4c3ccdc3 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.918890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2c00-a97e-4edb-a018-d99b4c3ccdc3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.919357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2c00-a97e-4edb-a018-d99b4c3ccdc3 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.922030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 679/1358] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 23 13:39:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:12.932089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf193776-3da4-4411-b2e7-9efad3fd1b5b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:12.932589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf193776-3da4-4411-b2e7-9efad3fd1b5b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:12.933042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf193776-3da4-4411-b2e7-9efad3fd1b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:12.979053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.989166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-cf193776-3da4-4411-b2e7-9efad3fd1b5b None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:12.991042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cf193776-3da4-4411-b2e7-9efad3fd1b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:13.076387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 680/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 23 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:13.084899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb2c00-a97e-4edb-a018-d99b4c3ccdc3 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:13.100612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb2c00-a97e-4edb-a018-d99b4c3ccdc3 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:13.106343 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2957e27-f674-4bea-9be1-fc985f277f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:13.107237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2957e27-f674-4bea-9be1-fc985f277f7c service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:13.107708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2957e27-f674-4bea-9be1-fc985f277f7c service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:13.108192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2957e27-f674-4bea-9be1-fc985f277f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:13.119026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2957e27-f674-4bea-9be1-fc985f277f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:13.121134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2957e27-f674-4bea-9be1-fc985f277f7c service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:13.132123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 680/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:15.377460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42935-d01c-403b-abcc-3f4d392f333f None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:15.378061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42935-d01c-403b-abcc-3f4d392f333f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:15.378061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42935-d01c-403b-abcc-3f4d392f333f None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:15.381030 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 681/1361] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:15.385403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31131021-2098-46d3-b731-e6cbc90f70cf None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:15.385850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31131021-2098-46d3-b731-e6cbc90f70cf None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:15.385947 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31131021-2098-46d3-b731-e6cbc90f70cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:15.404442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-31131021-2098-46d3-b731-e6cbc90f70cf None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:15.405646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-31131021-2098-46d3-b731-e6cbc90f70cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:15.414075 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 681/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:15.459036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42935-d01c-403b-abcc-3f4d392f333f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:15.473824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42935-d01c-403b-abcc-3f4d392f333f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:15.479195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd630-d3c2-49b6-8892-fcf2d8ac7c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:15.485285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd630-d3c2-49b6-8892-fcf2d8ac7c7c service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:15.485577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd630-d3c2-49b6-8892-fcf2d8ac7c7c service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:15.485861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd630-d3c2-49b6-8892-fcf2d8ac7c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:15.495226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dd630-d3c2-49b6-8892-fcf2d8ac7c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:15.496812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dd630-d3c2-49b6-8892-fcf2d8ac7c7c service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:15.507364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 682/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:17.878099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889ab8-deb3-43d0-adb9-94c07bacca45 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:17.878940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889ab8-deb3-43d0-adb9-94c07bacca45 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:17.879406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889ab8-deb3-43d0-adb9-94c07bacca45 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:17.881322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 682/1364] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:17.888936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615e13-82fa-40cd-8bc0-27a09b52bbf6 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:17.889770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615e13-82fa-40cd-8bc0-27a09b52bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:17.890227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615e13-82fa-40cd-8bc0-27a09b52bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:17.921010 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-80615e13-82fa-40cd-8bc0-27a09b52bbf6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:17.922135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-80615e13-82fa-40cd-8bc0-27a09b52bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:17.930226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 683/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:17.975887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8c5a-e46d-47a1-8fc3-c5cba179cde5 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:17.976177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8c5a-e46d-47a1-8fc3-c5cba179cde5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:17.976458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8c5a-e46d-47a1-8fc3-c5cba179cde5 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:17.977852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 683/1366] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 23 13:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:17.983145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102977e5-7744-4d06-ac03-88a00b59c75f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:17.983482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102977e5-7744-4d06-ac03-88a00b59c75f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:17.983847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102977e5-7744-4d06-ac03-88a00b59c75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.001755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-102977e5-7744-4d06-ac03-88a00b59c75f None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:18.002936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-102977e5-7744-4d06-ac03-88a00b59c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:18.012187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 684/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 23 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:18.019975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d8c5a-e46d-47a1-8fc3-c5cba179cde5 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:18.034851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d8c5a-e46d-47a1-8fc3-c5cba179cde5 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:18.040699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4764f2-b8e3-4e67-a7ab-6220242a4a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:18.041325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4764f2-b8e3-4e67-a7ab-6220242a4a63 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:18.041607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4764f2-b8e3-4e67-a7ab-6220242a4a63 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:18.041883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4764f2-b8e3-4e67-a7ab-6220242a4a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:18.049722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4764f2-b8e3-4e67-a7ab-6220242a4a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:18.051366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4764f2-b8e3-4e67-a7ab-6220242a4a63 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:18.060419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 684/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:20.271642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7646a-242f-4f9b-909f-81fefeaff429 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.272178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7646a-242f-4f9b-909f-81fefeaff429 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.272178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7646a-242f-4f9b-909f-81fefeaff429 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.273550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 685/1369] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:20.278795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f5a3-dbad-408b-8772-6d50d2adbf62 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.279237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f5a3-dbad-408b-8772-6d50d2adbf62 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.279445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f5a3-dbad-408b-8772-6d50d2adbf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.298784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d2a5f5a3-dbad-408b-8772-6d50d2adbf62 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:20.300026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d2a5f5a3-dbad-408b-8772-6d50d2adbf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:20.308465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 685/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:20.354056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7646a-242f-4f9b-909f-81fefeaff429 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:20.369432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7646a-242f-4f9b-909f-81fefeaff429 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:20.375129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8b71c-b96c-44fb-8032-14c1f457c679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:20.375968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b71c-b96c-44fb-8032-14c1f457c679 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.376415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b71c-b96c-44fb-8032-14c1f457c679 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.376854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b71c-b96c-44fb-8032-14c1f457c679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.385528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8b71c-b96c-44fb-8032-14c1f457c679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:20.387362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8b71c-b96c-44fb-8032-14c1f457c679 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:20.397776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 686/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:20.884514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e857-ac2b-4ce4-a7ec-4d8f31a60e7e None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.884800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e857-ac2b-4ce4-a7ec-4d8f31a60e7e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.885274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e857-ac2b-4ce4-a7ec-4d8f31a60e7e None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.886647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 686/1372] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:20.892348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a7cf-8860-4b6f-90bd-f61acfa196ef None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:20.892975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a7cf-8860-4b6f-90bd-f61acfa196ef None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:20.893343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a7cf-8860-4b6f-90bd-f61acfa196ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:20.912262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-fde3a7cf-8860-4b6f-90bd-f61acfa196ef None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:20.913525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-fde3a7cf-8860-4b6f-90bd-f61acfa196ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:20.923248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 687/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:21.265936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da65ae-371b-4758-94d8-f9c46e7495b3 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.266300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da65ae-371b-4758-94d8-f9c46e7495b3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.266714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da65ae-371b-4758-94d8-f9c46e7495b3 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.268660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 687/1374] 10.222.0.23 () {54 vars in 963 bytes} [Thu Jun 23 13:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:21.274094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be970b1-9236-440c-a726-06e708849b7f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.274605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be970b1-9236-440c-a726-06e708849b7f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.274806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be970b1-9236-440c-a726-06e708849b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.324390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0be970b1-9236-440c-a726-06e708849b7f None None] MFA Rules not processed for user `f98ec37cbc1f4da88cc2d7887b26aa41`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:21.325693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0be970b1-9236-440c-a726-06e708849b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:21.390034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 688/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Jun 23 13:39:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:21.398575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da65ae-371b-4758-94d8-f9c46e7495b3 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:21.410466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da65ae-371b-4758-94d8-f9c46e7495b3 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:21.415012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da00f9-45c1-4ec9-90db-6942c958e55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:21.415797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da00f9-45c1-4ec9-90db-6942c958e55c service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:21.416190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da00f9-45c1-4ec9-90db-6942c958e55c service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:21.416594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da00f9-45c1-4ec9-90db-6942c958e55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:21.426199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da00f9-45c1-4ec9-90db-6942c958e55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:21.428348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da00f9-45c1-4ec9-90db-6942c958e55c service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:21.438439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 688/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:22.473528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210620-ec8b-4a70-bf34-35bfc416ce83 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:22.474626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210620-ec8b-4a70-bf34-35bfc416ce83 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:22.474626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210620-ec8b-4a70-bf34-35bfc416ce83 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:22.476009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 689/1377] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:22.481256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1746-9be5-4d2c-9045-0815df168710 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:22.481680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1746-9be5-4d2c-9045-0815df168710 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:22.481850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1746-9be5-4d2c-9045-0815df168710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:22.499290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-594d1746-9be5-4d2c-9045-0815df168710 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:22.500543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-594d1746-9be5-4d2c-9045-0815df168710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:22.508568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 689/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:22.552879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62210620-ec8b-4a70-bf34-35bfc416ce83 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:22.566941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62210620-ec8b-4a70-bf34-35bfc416ce83 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:22.572273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6736-623a-422c-a883-1ee7a525d40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:22.572888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6736-623a-422c-a883-1ee7a525d40a service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:22.573173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6736-623a-422c-a883-1ee7a525d40a service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:22.573451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6736-623a-422c-a883-1ee7a525d40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:22.581350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f6736-623a-422c-a883-1ee7a525d40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:22.582915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f6736-623a-422c-a883-1ee7a525d40a service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:22.587250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:22.594263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 690/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:24.656927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ec45-fd0a-4833-93e6-163b9387ad5a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.657437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ec45-fd0a-4833-93e6-163b9387ad5a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.657537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ec45-fd0a-4833-93e6-163b9387ad5a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.658874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 690/1380] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:24.665577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e61e63-0951-4714-8242-2cdb66efda97 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.666006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e61e63-0951-4714-8242-2cdb66efda97 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.666326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e61e63-0951-4714-8242-2cdb66efda97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.686227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-c3e61e63-0951-4714-8242-2cdb66efda97 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:24.687491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c3e61e63-0951-4714-8242-2cdb66efda97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:24.696902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 691/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:24.741637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8ec45-fd0a-4833-93e6-163b9387ad5a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:24.757871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8ec45-fd0a-4833-93e6-163b9387ad5a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:24.763529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8344d-a0a7-476f-a21e-925e594b4fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:24.766622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8344d-a0a7-476f-a21e-925e594b4fa6 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:24.766936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8344d-a0a7-476f-a21e-925e594b4fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:24.767244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8344d-a0a7-476f-a21e-925e594b4fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:24.777094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8344d-a0a7-476f-a21e-925e594b4fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:24.778937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8344d-a0a7-476f-a21e-925e594b4fa6 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:24.795601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 691/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:26.895126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d810-3bbb-4d77-a7d1-6363fcc9359c None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:26.895734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d810-3bbb-4d77-a7d1-6363fcc9359c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:26.895734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d810-3bbb-4d77-a7d1-6363fcc9359c None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:26.897134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 692/1383] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:26.902761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ffbb9-4df5-40f7-a1b2-bbe585362510 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:26.903316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ffbb9-4df5-40f7-a1b2-bbe585362510 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:26.903400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ffbb9-4df5-40f7-a1b2-bbe585362510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:26.922373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e43ffbb9-4df5-40f7-a1b2-bbe585362510 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:26.923639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e43ffbb9-4df5-40f7-a1b2-bbe585362510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:26.932501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 692/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:26.976196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d810-3bbb-4d77-a7d1-6363fcc9359c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:26.991740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d810-3bbb-4d77-a7d1-6363fcc9359c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:27.004676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a37b-f9bd-43c9-bf4b-d10df7df06f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:27.006251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a37b-f9bd-43c9-bf4b-d10df7df06f3 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:27.006991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a37b-f9bd-43c9-bf4b-d10df7df06f3 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:27.007516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a37b-f9bd-43c9-bf4b-d10df7df06f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:27.017274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a37b-f9bd-43c9-bf4b-d10df7df06f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:27.019603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a37b-f9bd-43c9-bf4b-d10df7df06f3 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:27.031992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 693/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:39:29.059611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46c75-e29a-4954-96e1-6b98ff5411a6 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.060320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46c75-e29a-4954-96e1-6b98ff5411a6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.060320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46c75-e29a-4954-96e1-6b98ff5411a6 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.061516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 693/1386] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:29.066594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6afa4-d7ad-43bd-a078-3b5c3d018924 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.067149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6afa4-d7ad-43bd-a078-3b5c3d018924 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.067149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6afa4-d7ad-43bd-a078-3b5c3d018924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.085510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-02c6afa4-d7ad-43bd-a078-3b5c3d018924 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:29.086694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-02c6afa4-d7ad-43bd-a078-3b5c3d018924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:29.094355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 694/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:29.139782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46c75-e29a-4954-96e1-6b98ff5411a6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:29.154402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46c75-e29a-4954-96e1-6b98ff5411a6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:29.159892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee47ec8-2a49-4bcc-9d50-85128665383c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:29.160533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47ec8-2a49-4bcc-9d50-85128665383c service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:29.160819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47ec8-2a49-4bcc-9d50-85128665383c service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:29.161098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47ec8-2a49-4bcc-9d50-85128665383c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:29.169351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee47ec8-2a49-4bcc-9d50-85128665383c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:29.170936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee47ec8-2a49-4bcc-9d50-85128665383c service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:29.181173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 694/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:31.266366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece2e59-6130-4954-8a50-b7932614fc0d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.267088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece2e59-6130-4954-8a50-b7932614fc0d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.267088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece2e59-6130-4954-8a50-b7932614fc0d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.268526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 695/1389] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:31.273759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb31be-c8e7-4ecb-897e-bd6bad5d4d51 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.274230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb31be-c8e7-4ecb-897e-bd6bad5d4d51 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.274476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb31be-c8e7-4ecb-897e-bd6bad5d4d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.293108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-43eb31be-c8e7-4ecb-897e-bd6bad5d4d51 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:31.294302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-43eb31be-c8e7-4ecb-897e-bd6bad5d4d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:31.302916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 695/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:31.347627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece2e59-6130-4954-8a50-b7932614fc0d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:31.362559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece2e59-6130-4954-8a50-b7932614fc0d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:31.368805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924e5d6-a965-4203-8f0f-8b360ac6d3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:31.369440 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e5d6-a965-4203-8f0f-8b360ac6d3a2 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:31.369784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e5d6-a965-4203-8f0f-8b360ac6d3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:31.369997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e5d6-a965-4203-8f0f-8b360ac6d3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:31.378104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924e5d6-a965-4203-8f0f-8b360ac6d3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:31.379731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924e5d6-a965-4203-8f0f-8b360ac6d3a2 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:31.389110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 696/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:33.437102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d83e-cd97-4dfa-8f44-8c745da4cf22 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.437716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d83e-cd97-4dfa-8f44-8c745da4cf22 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.437716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d83e-cd97-4dfa-8f44-8c745da4cf22 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.439048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 696/1392] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:33.446627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1086c5-da35-4dda-86fe-cd1d6de1abf9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.447105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1086c5-da35-4dda-86fe-cd1d6de1abf9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.447187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1086c5-da35-4dda-86fe-cd1d6de1abf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.464720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-5d1086c5-da35-4dda-86fe-cd1d6de1abf9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:33.465919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5d1086c5-da35-4dda-86fe-cd1d6de1abf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:33.473735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 697/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:33.531895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7d83e-cd97-4dfa-8f44-8c745da4cf22 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:33.546717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7d83e-cd97-4dfa-8f44-8c745da4cf22 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:33.553103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed908f-c550-47ec-bf75-530328fce0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:33.553757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed908f-c550-47ec-bf75-530328fce0d4 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:33.554042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed908f-c550-47ec-bf75-530328fce0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:33.554320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed908f-c550-47ec-bf75-530328fce0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:33.562587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed908f-c550-47ec-bf75-530328fce0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:33.564192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed908f-c550-47ec-bf75-530328fce0d4 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:33.573600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 697/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:35.686850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a084126-f31d-4a0e-a336-ccd76779e66f None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.687406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a084126-f31d-4a0e-a336-ccd76779e66f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.687503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a084126-f31d-4a0e-a336-ccd76779e66f None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.688811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 698/1395] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:35.693913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807e65-6a96-4185-882f-0e89827b5981 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.694368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807e65-6a96-4185-882f-0e89827b5981 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.694503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807e65-6a96-4185-882f-0e89827b5981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.712646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-83807e65-6a96-4185-882f-0e89827b5981 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:35.713819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-83807e65-6a96-4185-882f-0e89827b5981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:35.721501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 698/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:35.770470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a084126-f31d-4a0e-a336-ccd76779e66f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:35.793410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a084126-f31d-4a0e-a336-ccd76779e66f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:35.798742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4efb3-23e3-4f17-9186-dd53db46e0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:35.799406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4efb3-23e3-4f17-9186-dd53db46e0a7 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:35.799690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4efb3-23e3-4f17-9186-dd53db46e0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:35.799967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4efb3-23e3-4f17-9186-dd53db46e0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:35.808090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4efb3-23e3-4f17-9186-dd53db46e0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:35.809659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4efb3-23e3-4f17-9186-dd53db46e0a7 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:35.819298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 699/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:36.494388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27844-f4c9-4216-b7d1-77f71a40a206 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.494681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27844-f4c9-4216-b7d1-77f71a40a206 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.494962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27844-f4c9-4216-b7d1-77f71a40a206 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.496405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 699/1398] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:36.501638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f942-3600-4c69-aed3-960b5538b642 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.501939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f942-3600-4c69-aed3-960b5538b642 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.502230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f942-3600-4c69-aed3-960b5538b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.520476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ed33f942-3600-4c69-aed3-960b5538b642 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:36.521716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ed33f942-3600-4c69-aed3-960b5538b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:36.529509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 700/1399] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:36.587796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e75e7f-b6fe-4c67-8200-48ed77e86fca None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.588090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e75e7f-b6fe-4c67-8200-48ed77e86fca None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.588398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e75e7f-b6fe-4c67-8200-48ed77e86fca None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.589813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 700/1400] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jun 23 13:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:36.595091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abac9a-cd04-4031-9394-df8f66aaaff5 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.595480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abac9a-cd04-4031-9394-df8f66aaaff5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.595852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abac9a-cd04-4031-9394-df8f66aaaff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.644329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b3abac9a-cd04-4031-9394-df8f66aaaff5 None None] MFA Rules not processed for user `e54dc244053a4253aa32f1eebd655589`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:36.645523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b3abac9a-cd04-4031-9394-df8f66aaaff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:36.703981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 701/1401] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jun 23 13:39:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:36.711583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e75e7f-b6fe-4c67-8200-48ed77e86fca None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:36.722037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e75e7f-b6fe-4c67-8200-48ed77e86fca None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:36.726040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346577c-df60-45b4-a38c-286d53efbe67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:36.726669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346577c-df60-45b4-a38c-286d53efbe67 service glance] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:36.726954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346577c-df60-45b4-a38c-286d53efbe67 service glance] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:36.727246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346577c-df60-45b4-a38c-286d53efbe67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:36.736033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346577c-df60-45b4-a38c-286d53efbe67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:36.737398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346577c-df60-45b4-a38c-286d53efbe67 service glance] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:36.747351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 701/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:37.456801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865654fe-970e-41cb-bb76-d92a411c2434 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.457169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865654fe-970e-41cb-bb76-d92a411c2434 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.457524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865654fe-970e-41cb-bb76-d92a411c2434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.511742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-865654fe-970e-41cb-bb76-d92a411c2434 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:37.512935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-865654fe-970e-41cb-bb76-d92a411c2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:37.552726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:37.576613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 702/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:39:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:37.617356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649be30-4ab5-4b4e-8c12-bc78e314fc7a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.617733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649be30-4ab5-4b4e-8c12-bc78e314fc7a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.618078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649be30-4ab5-4b4e-8c12-bc78e314fc7a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.619510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 702/1404] 10.222.0.23 () {54 vars in 942 bytes} [Thu Jun 23 13:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:37.625874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e46e45-6cc5-4ef1-b5c1-0922d6aef07a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.626200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e46e45-6cc5-4ef1-b5c1-0922d6aef07a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.626475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e46e45-6cc5-4ef1-b5c1-0922d6aef07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.674682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-22e46e45-6cc5-4ef1-b5c1-0922d6aef07a None None] MFA Rules not processed for user `edc00ecebf0c451b94b56e3e97254010`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:37.675830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-22e46e45-6cc5-4ef1-b5c1-0922d6aef07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:37.745563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 703/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Thu Jun 23 13:39:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:39:37.754790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649be30-4ab5-4b4e-8c12-bc78e314fc7a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:37.768583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649be30-4ab5-4b4e-8c12-bc78e314fc7a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:37.774012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55a09b-e73a-4613-9900-4f7ab27a2f4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:37.774648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55a09b-e73a-4613-9900-4f7ab27a2f4f service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.774937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55a09b-e73a-4613-9900-4f7ab27a2f4f service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.775231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55a09b-e73a-4613-9900-4f7ab27a2f4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.786062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55a09b-e73a-4613-9900-4f7ab27a2f4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:37.788256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55a09b-e73a-4613-9900-4f7ab27a2f4f service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:37.796698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 703/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:37.894896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e8512-780b-4761-98df-c3662e599f97 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.895321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e8512-780b-4761-98df-c3662e599f97 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.895507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e8512-780b-4761-98df-c3662e599f97 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.897553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 704/1407] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:39:37.903013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fc046-bb95-4df8-81c0-3044a0ac6e79 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:37.903381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fc046-bb95-4df8-81c0-3044a0ac6e79 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:37.903672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fc046-bb95-4df8-81c0-3044a0ac6e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:37.925271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a37fc046-bb95-4df8-81c0-3044a0ac6e79 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:39:37.926401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a37fc046-bb95-4df8-81c0-3044a0ac6e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:39:37.934854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 704/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:39:37.981805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e8512-780b-4761-98df-c3662e599f97 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:39:37.997233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e8512-780b-4761-98df-c3662e599f97 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:39:38.002851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797000d-3233-4842-b928-7f5e7d3f7d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:39:38.003736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797000d-3233-4842-b928-7f5e7d3f7d90 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:39:38.004221 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797000d-3233-4842-b928-7f5e7d3f7d90 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:39:38.004709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797000d-3233-4842-b928-7f5e7d3f7d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:39:38.014398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797000d-3233-4842-b928-7f5e7d3f7d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:39:38.016171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797000d-3233-4842-b928-7f5e7d3f7d90 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:39:38.027804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 705/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:39:47.919435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=69 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:48.022961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=59 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:00.130961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a094c7a-3eec-4663-8431-04a02d2dcc14 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.131620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a094c7a-3eec-4663-8431-04a02d2dcc14 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.131620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a094c7a-3eec-4663-8431-04a02d2dcc14 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.132922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 705/1410] 10.222.0.23 () {54 vars in 918 bytes} [Thu Jun 23 13:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:00.137989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749da79-5efb-4610-a4e8-67a75c3e8ad7 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.138419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749da79-5efb-4610-a4e8-67a75c3e8ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.138603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749da79-5efb-4610-a4e8-67a75c3e8ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.157937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f749da79-5efb-4610-a4e8-67a75c3e8ad7 None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:00.159274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f749da79-5efb-4610-a4e8-67a75c3e8ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.168037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 706/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jun 23 13:40:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:00.182301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73ab4-5f99-415c-974c-f41e4c9f1250 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.182595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73ab4-5f99-415c-974c-f41e4c9f1250 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.182907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73ab4-5f99-415c-974c-f41e4c9f1250 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.184317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 706/1412] 10.222.0.23 () {54 vars in 918 bytes} [Thu Jun 23 13:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:00.188724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87703182-b60a-4802-9972-135ad1b16b66 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:00.189016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87703182-b60a-4802-9972-135ad1b16b66 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:00.189301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87703182-b60a-4802-9972-135ad1b16b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:00.207103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-87703182-b60a-4802-9972-135ad1b16b66 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:00.208330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-87703182-b60a-4802-9972-135ad1b16b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:00.217231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 707/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jun 23 13:40:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:02.703152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0886-9f85-4dc7-a3e8-d45c1d6004cf None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.703647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0886-9f85-4dc7-a3e8-d45c1d6004cf None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.703755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0886-9f85-4dc7-a3e8-d45c1d6004cf None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.705147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:02.710474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8facc-f273-4ef0-964b-880495ac4b8d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.710896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8facc-f273-4ef0-964b-880495ac4b8d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.711039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8facc-f273-4ef0-964b-880495ac4b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.728971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-04e8facc-f273-4ef0-964b-880495ac4b8d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:02.730784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-04e8facc-f273-4ef0-964b-880495ac4b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:02.742729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:02.786861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a0886-9f85-4dc7-a3e8-d45c1d6004cf None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:02.802439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a0886-9f85-4dc7-a3e8-d45c1d6004cf None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:02.807829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3f02d-4110-41b8-bb9e-d2ea8806477f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:02.808465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f02d-4110-41b8-bb9e-d2ea8806477f service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:02.808747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f02d-4110-41b8-bb9e-d2ea8806477f service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:02.809021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f02d-4110-41b8-bb9e-d2ea8806477f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:02.817015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3f02d-4110-41b8-bb9e-d2ea8806477f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:02.818582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3f02d-4110-41b8-bb9e-d2ea8806477f service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:02.828330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 708/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:03.746651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8c60-5c29-461f-812d-b909597916d9 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.747183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8c60-5c29-461f-812d-b909597916d9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.747183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8c60-5c29-461f-812d-b909597916d9 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.748554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:03.753518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdfac-cc0b-4738-af36-27f1b36ccd7e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.753966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdfac-cc0b-4738-af36-27f1b36ccd7e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.754076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdfac-cc0b-4738-af36-27f1b36ccd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.774032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-184cdfac-cc0b-4738-af36-27f1b36ccd7e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:03.775282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-184cdfac-cc0b-4738-af36-27f1b36ccd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:03.783259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:03.932771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8c60-5c29-461f-812d-b909597916d9 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:03.947660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8c60-5c29-461f-812d-b909597916d9 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:03.953080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e6669-8b76-4ab2-ae4a-33047620f51c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:03.953745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6669-8b76-4ab2-ae4a-33047620f51c service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:03.954039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6669-8b76-4ab2-ae4a-33047620f51c service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:03.954352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6669-8b76-4ab2-ae4a-33047620f51c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:03.962902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e6669-8b76-4ab2-ae4a-33047620f51c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:03.964594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e6669-8b76-4ab2-ae4a-33047620f51c service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:03.974210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 710/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:04.851138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8ca5a-8db0-4f00-9432-ef182a863bcd None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.851700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8ca5a-8db0-4f00-9432-ef182a863bcd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.851808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8ca5a-8db0-4f00-9432-ef182a863bcd None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.853102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:04.857974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493cbc2-1c7e-4a20-baa5-7ee9f3ece905 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:04.858420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493cbc2-1c7e-4a20-baa5-7ee9f3ece905 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:04.858529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493cbc2-1c7e-4a20-baa5-7ee9f3ece905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:04.876062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2493cbc2-1c7e-4a20-baa5-7ee9f3ece905 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:04.877249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2493cbc2-1c7e-4a20-baa5-7ee9f3ece905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:04.884891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:05.034291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8ca5a-8db0-4f00-9432-ef182a863bcd None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:05.048731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8ca5a-8db0-4f00-9432-ef182a863bcd None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:05.054602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b5df4-beb8-4400-b2be-d8e88b5b47e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:05.055244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b5df4-beb8-4400-b2be-d8e88b5b47e9 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:05.055532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b5df4-beb8-4400-b2be-d8e88b5b47e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:05.055807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b5df4-beb8-4400-b2be-d8e88b5b47e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:05.063616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b5df4-beb8-4400-b2be-d8e88b5b47e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:05.065182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b5df4-beb8-4400-b2be-d8e88b5b47e9 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:05.074429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 711/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:05.958894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b247-040e-41b4-83c8-d43a61d7a51d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:05.959481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b247-040e-41b4-83c8-d43a61d7a51d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:05.959481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b247-040e-41b4-83c8-d43a61d7a51d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:05.960892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:05.965958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61935a3a-c49d-4837-bf9a-918da1aeddcc None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:05.966367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61935a3a-c49d-4837-bf9a-918da1aeddcc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:05.966521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61935a3a-c49d-4837-bf9a-918da1aeddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:05.984100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-61935a3a-c49d-4837-bf9a-918da1aeddcc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:05.985280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-61935a3a-c49d-4837-bf9a-918da1aeddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:05.993175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:06.143571 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b247-040e-41b4-83c8-d43a61d7a51d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:06.158688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b247-040e-41b4-83c8-d43a61d7a51d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:06.164039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd292c-fab5-4836-8ddc-32fe6e5a74fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:06.164681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd292c-fab5-4836-8ddc-32fe6e5a74fb service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:06.164970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd292c-fab5-4836-8ddc-32fe6e5a74fb service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:06.165253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd292c-fab5-4836-8ddc-32fe6e5a74fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:06.173309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd292c-fab5-4836-8ddc-32fe6e5a74fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:06.174892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd292c-fab5-4836-8ddc-32fe6e5a74fb service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:06.184741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 713/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:07.040676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48492-80b2-41bc-9fd8-55fd957f2fd8 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:07.041258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48492-80b2-41bc-9fd8-55fd957f2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:07.041258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48492-80b2-41bc-9fd8-55fd957f2fd8 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:07.042617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:07.047644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5da2-d7cd-4fae-a180-d8e8ea981442 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:07.048042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5da2-d7cd-4fae-a180-d8e8ea981442 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:07.048208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5da2-d7cd-4fae-a180-d8e8ea981442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:07.066648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-58ab5da2-d7cd-4fae-a180-d8e8ea981442 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:07.068795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-58ab5da2-d7cd-4fae-a180-d8e8ea981442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:07.076494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:07.229663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48492-80b2-41bc-9fd8-55fd957f2fd8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:07.243783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48492-80b2-41bc-9fd8-55fd957f2fd8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:07.249083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf90ea4-aabd-4835-b6be-72c2e0cbb759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:07.249717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90ea4-aabd-4835-b6be-72c2e0cbb759 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:07.250006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90ea4-aabd-4835-b6be-72c2e0cbb759 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:07.250288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90ea4-aabd-4835-b6be-72c2e0cbb759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:07.258741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf90ea4-aabd-4835-b6be-72c2e0cbb759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:07.260357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf90ea4-aabd-4835-b6be-72c2e0cbb759 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:07.269940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 714/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:08.068246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213117a4-3641-402a-8d58-e25c419f5313 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:08.068808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213117a4-3641-402a-8d58-e25c419f5313 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:08.068808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213117a4-3641-402a-8d58-e25c419f5313 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:08.070192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:08.075128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557f48c-3a91-4a32-9dad-44c7df90629a None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:08.075566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557f48c-3a91-4a32-9dad-44c7df90629a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:08.075769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557f48c-3a91-4a32-9dad-44c7df90629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:08.093955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4557f48c-3a91-4a32-9dad-44c7df90629a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:08.095136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4557f48c-3a91-4a32-9dad-44c7df90629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:08.102953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:08.249506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213117a4-3641-402a-8d58-e25c419f5313 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:08.264026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213117a4-3641-402a-8d58-e25c419f5313 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:08.269629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76485f-8b20-4c33-9411-99a7fc8df851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:08.270866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76485f-8b20-4c33-9411-99a7fc8df851 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:08.271153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76485f-8b20-4c33-9411-99a7fc8df851 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:08.271462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76485f-8b20-4c33-9411-99a7fc8df851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:08.279349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76485f-8b20-4c33-9411-99a7fc8df851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:08.280928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76485f-8b20-4c33-9411-99a7fc8df851 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:08.290141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 716/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:09.086651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479ba5-181b-433c-a9e8-b7c6b2857a8b None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:09.087247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479ba5-181b-433c-a9e8-b7c6b2857a8b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:09.087247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479ba5-181b-433c-a9e8-b7c6b2857a8b None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:09.088625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:09.093391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59944f2-b4d2-4a72-9a5d-c2aac4bec173 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:09.093828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59944f2-b4d2-4a72-9a5d-c2aac4bec173 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:09.093984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59944f2-b4d2-4a72-9a5d-c2aac4bec173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:09.111957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f59944f2-b4d2-4a72-9a5d-c2aac4bec173 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:09.113137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f59944f2-b4d2-4a72-9a5d-c2aac4bec173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:09.121334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:09.269571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479ba5-181b-433c-a9e8-b7c6b2857a8b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:09.283998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479ba5-181b-433c-a9e8-b7c6b2857a8b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:09.289821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610ec4c-60ab-4df4-987f-3046834fc7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:09.290477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ec4c-60ab-4df4-987f-3046834fc7ed service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:09.290761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ec4c-60ab-4df4-987f-3046834fc7ed service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:09.291041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ec4c-60ab-4df4-987f-3046834fc7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:09.298840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610ec4c-60ab-4df4-987f-3046834fc7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:09.300449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610ec4c-60ab-4df4-987f-3046834fc7ed service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:09.309839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 717/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:10.110150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df653c-bdff-4368-86ad-c00b46fd7659 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.110751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df653c-bdff-4368-86ad-c00b46fd7659 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.110751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df653c-bdff-4368-86ad-c00b46fd7659 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.112100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:10.117429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28cf3-ace1-45b1-8396-eef1c7756d6d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.117851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28cf3-ace1-45b1-8396-eef1c7756d6d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.117991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd28cf3-ace1-45b1-8396-eef1c7756d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.135962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8bd28cf3-ace1-45b1-8396-eef1c7756d6d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:10.137166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8bd28cf3-ace1-45b1-8396-eef1c7756d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:10.145052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:10.293546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df653c-bdff-4368-86ad-c00b46fd7659 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:10.308042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df653c-bdff-4368-86ad-c00b46fd7659 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:10.313244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec3dc7-858c-4928-8037-9927bb79c9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:10.313873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec3dc7-858c-4928-8037-9927bb79c9a7 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:10.314158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec3dc7-858c-4928-8037-9927bb79c9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:10.314435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec3dc7-858c-4928-8037-9927bb79c9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:10.322296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec3dc7-858c-4928-8037-9927bb79c9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:10.323934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec3dc7-858c-4928-8037-9927bb79c9a7 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:10.332984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 719/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:11.131271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009a55f-92e7-4998-b59f-f88c5b1a5e8d None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:11.131873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009a55f-92e7-4998-b59f-f88c5b1a5e8d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:11.131873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009a55f-92e7-4998-b59f-f88c5b1a5e8d None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:11.133279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:11.138168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd252d-0bb9-473a-87b4-119f5e7bd704 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:11.138596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd252d-0bb9-473a-87b4-119f5e7bd704 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:11.138715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd252d-0bb9-473a-87b4-119f5e7bd704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:11.156418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-76bd252d-0bb9-473a-87b4-119f5e7bd704 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:11.157586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-76bd252d-0bb9-473a-87b4-119f5e7bd704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:11.165768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:11.314469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009a55f-92e7-4998-b59f-f88c5b1a5e8d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:11.328629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009a55f-92e7-4998-b59f-f88c5b1a5e8d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:11.333986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a48c1-7da3-43a1-8652-0bd617d2f675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:11.334621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a48c1-7da3-43a1-8652-0bd617d2f675 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:11.334908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a48c1-7da3-43a1-8652-0bd617d2f675 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:11.335186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a48c1-7da3-43a1-8652-0bd617d2f675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:11.343077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a48c1-7da3-43a1-8652-0bd617d2f675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:11.344685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a48c1-7da3-43a1-8652-0bd617d2f675 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:11.354296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 720/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:13.273777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5702-3ad2-4273-b2c7-623de758755c None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.274346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5702-3ad2-4273-b2c7-623de758755c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.274346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d5702-3ad2-4273-b2c7-623de758755c None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.275833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:13.281076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be2a8a-2683-4aa2-8cc4-c077f1a8dcc5 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.281490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be2a8a-2683-4aa2-8cc4-c077f1a8dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.281638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be2a8a-2683-4aa2-8cc4-c077f1a8dcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.299448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-84be2a8a-2683-4aa2-8cc4-c077f1a8dcc5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:13.300638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-84be2a8a-2683-4aa2-8cc4-c077f1a8dcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:13.308915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:13.346103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d5702-3ad2-4273-b2c7-623de758755c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:13.357231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d5702-3ad2-4273-b2c7-623de758755c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:13.360768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb56f91-1d66-453e-abf4-39d09f87550c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:13.361404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56f91-1d66-453e-abf4-39d09f87550c service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:13.361734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56f91-1d66-453e-abf4-39d09f87550c service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:13.362019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56f91-1d66-453e-abf4-39d09f87550c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:13.371399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56f91-1d66-453e-abf4-39d09f87550c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:13.372815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56f91-1d66-453e-abf4-39d09f87550c service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:13.382027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 722/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:40:15.603742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907082fb-5105-4203-92e4-065e49f1ab79 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:15.604266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907082fb-5105-4203-92e4-065e49f1ab79 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:15.604390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907082fb-5105-4203-92e4-065e49f1ab79 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:15.605666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:15.611018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b5cd-4f42-4028-b082-c2c630efc80a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:15.611457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b5cd-4f42-4028-b082-c2c630efc80a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:15.611677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b5cd-4f42-4028-b082-c2c630efc80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:15.628740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2419b5cd-4f42-4028-b082-c2c630efc80a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:15.630429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2419b5cd-4f42-4028-b082-c2c630efc80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:15.637977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:15.681999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907082fb-5105-4203-92e4-065e49f1ab79 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:15.693630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907082fb-5105-4203-92e4-065e49f1ab79 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:15.697288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3311-e3dc-483b-8268-402c91e3a885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:15.697929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3311-e3dc-483b-8268-402c91e3a885 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:15.698215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3311-e3dc-483b-8268-402c91e3a885 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:15.698493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3311-e3dc-483b-8268-402c91e3a885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:15.707429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3311-e3dc-483b-8268-402c91e3a885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:15.709446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3311-e3dc-483b-8268-402c91e3a885 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:15.718568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 723/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:18.033685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1c4f-ad19-4ffe-82d9-82b11853935d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.034244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1c4f-ad19-4ffe-82d9-82b11853935d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.034244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1c4f-ad19-4ffe-82d9-82b11853935d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.035657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:18.040994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3e8f-5692-4480-baff-0593a4535c53 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.041423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3e8f-5692-4480-baff-0593a4535c53 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.041566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3e8f-5692-4480-baff-0593a4535c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.058779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d58c3e8f-5692-4480-baff-0593a4535c53 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:18.059997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d58c3e8f-5692-4480-baff-0593a4535c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:18.068369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:18.106358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b1c4f-ad19-4ffe-82d9-82b11853935d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:18.116918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b1c4f-ad19-4ffe-82d9-82b11853935d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:18.120394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcfb9f-cff1-4bad-9e71-af2c40c69085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:18.121027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcfb9f-cff1-4bad-9e71-af2c40c69085 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:18.121313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcfb9f-cff1-4bad-9e71-af2c40c69085 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:18.121590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcfb9f-cff1-4bad-9e71-af2c40c69085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:18.130784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcfb9f-cff1-4bad-9e71-af2c40c69085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:18.132240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcfb9f-cff1-4bad-9e71-af2c40c69085 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:18.141502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 725/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:20.307767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf473-321a-4224-a60a-b53eaeccbcaa None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.308344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf473-321a-4224-a60a-b53eaeccbcaa None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.308344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf473-321a-4224-a60a-b53eaeccbcaa None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.309695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:20.314907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a745-98ee-4283-ad87-3ead0cd5d084 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.315373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a745-98ee-4283-ad87-3ead0cd5d084 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.315512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a745-98ee-4283-ad87-3ead0cd5d084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.333192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ae27a745-98ee-4283-ad87-3ead0cd5d084 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:20.334421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ae27a745-98ee-4283-ad87-3ead0cd5d084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:20.342305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:20.380857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf473-321a-4224-a60a-b53eaeccbcaa None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:20.391267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf473-321a-4224-a60a-b53eaeccbcaa None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:20.395412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad202ba-b584-4006-8611-bcf00a0a0521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:20.396066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad202ba-b584-4006-8611-bcf00a0a0521 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:20.396350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad202ba-b584-4006-8611-bcf00a0a0521 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:20.396626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad202ba-b584-4006-8611-bcf00a0a0521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:20.405148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad202ba-b584-4006-8611-bcf00a0a0521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:20.406558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad202ba-b584-4006-8611-bcf00a0a0521 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:20.416247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 726/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:22.503284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da363ff-8968-4f10-9bbd-83822a7e36d0 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:22.503759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da363ff-8968-4f10-9bbd-83822a7e36d0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:22.503868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da363ff-8968-4f10-9bbd-83822a7e36d0 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:22.505735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:22.510844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b691-1982-48fd-9796-37203219b105 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:22.511311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b691-1982-48fd-9796-37203219b105 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:22.511443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b691-1982-48fd-9796-37203219b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:22.530385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3068b691-1982-48fd-9796-37203219b105 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:22.531621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3068b691-1982-48fd-9796-37203219b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:22.539287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:22.578306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da363ff-8968-4f10-9bbd-83822a7e36d0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:22.590008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da363ff-8968-4f10-9bbd-83822a7e36d0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:22.593549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd21711-9bae-4c54-aca9-c2421d386310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:22.594252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21711-9bae-4c54-aca9-c2421d386310 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:22.594541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21711-9bae-4c54-aca9-c2421d386310 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:22.594816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21711-9bae-4c54-aca9-c2421d386310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:22.603670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd21711-9bae-4c54-aca9-c2421d386310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:22.605096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd21711-9bae-4c54-aca9-c2421d386310 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:22.614436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 728/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:24.689094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682cc2-c459-4be2-be31-a8290035e3b9 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:24.689578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682cc2-c459-4be2-be31-a8290035e3b9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:24.689684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682cc2-c459-4be2-be31-a8290035e3b9 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:24.691057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:24.696402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757953-18bc-4101-bb4d-4367eb37dfa5 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:24.696819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757953-18bc-4101-bb4d-4367eb37dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:24.696941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757953-18bc-4101-bb4d-4367eb37dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:24.714083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-82757953-18bc-4101-bb4d-4367eb37dfa5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:24.715278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-82757953-18bc-4101-bb4d-4367eb37dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:24.722799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:24.760870 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682cc2-c459-4be2-be31-a8290035e3b9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:24.771581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682cc2-c459-4be2-be31-a8290035e3b9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:24.775004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80e09d-a9bc-4129-8489-0a27db57962d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:24.775671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e09d-a9bc-4129-8489-0a27db57962d service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:24.775953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e09d-a9bc-4129-8489-0a27db57962d service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:24.776229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e09d-a9bc-4129-8489-0a27db57962d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:24.784732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80e09d-a9bc-4129-8489-0a27db57962d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:24.786695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80e09d-a9bc-4129-8489-0a27db57962d service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:24.795803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 729/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:26.868410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453bc66-aed3-4aa9-8fbb-f36a01108435 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:26.868967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453bc66-aed3-4aa9-8fbb-f36a01108435 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:26.868967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453bc66-aed3-4aa9-8fbb-f36a01108435 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:26.870330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:26.875657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d74941-6f44-4f37-b22c-223f8fae2cfb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:26.876038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d74941-6f44-4f37-b22c-223f8fae2cfb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:26.876215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d74941-6f44-4f37-b22c-223f8fae2cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:26.893580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-08d74941-6f44-4f37-b22c-223f8fae2cfb None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:26.894754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-08d74941-6f44-4f37-b22c-223f8fae2cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:26.902400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:26.939724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453bc66-aed3-4aa9-8fbb-f36a01108435 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:26.950143 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453bc66-aed3-4aa9-8fbb-f36a01108435 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:26.953609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28adab0-8a94-470e-bcb6-52f06032092c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:26.954243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28adab0-8a94-470e-bcb6-52f06032092c service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:26.954528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28adab0-8a94-470e-bcb6-52f06032092c service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:26.954808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28adab0-8a94-470e-bcb6-52f06032092c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:26.963497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28adab0-8a94-470e-bcb6-52f06032092c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:26.964915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28adab0-8a94-470e-bcb6-52f06032092c service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:26.974552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 731/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:29.030830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ce697-67e8-49a0-a467-a2d2ea38d66a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:29.031498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ce697-67e8-49a0-a467-a2d2ea38d66a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:29.031498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ce697-67e8-49a0-a467-a2d2ea38d66a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:29.032818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:29.038232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325060f-255a-43d4-aa50-01aa8a8702d1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:29.038633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325060f-255a-43d4-aa50-01aa8a8702d1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:29.038818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325060f-255a-43d4-aa50-01aa8a8702d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:29.044783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=79 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:29.057325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6325060f-255a-43d4-aa50-01aa8a8702d1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:29.058529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6325060f-255a-43d4-aa50-01aa8a8702d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:29.066332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:29.103940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ce697-67e8-49a0-a467-a2d2ea38d66a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:29.109260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=73 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:29.115545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ce697-67e8-49a0-a467-a2d2ea38d66a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:29.119172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0954614-4413-4bd7-abec-0988a423f4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:29.119842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0954614-4413-4bd7-abec-0988a423f4bd service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:29.120127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0954614-4413-4bd7-abec-0988a423f4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:29.120407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0954614-4413-4bd7-abec-0988a423f4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:29.129866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0954614-4413-4bd7-abec-0988a423f4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:29.131334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0954614-4413-4bd7-abec-0988a423f4bd service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:29.140532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 732/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:31.161699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b435e1-9b44-4231-9f6f-66a85b9146ad None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:31.162253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b435e1-9b44-4231-9f6f-66a85b9146ad None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:31.162253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b435e1-9b44-4231-9f6f-66a85b9146ad None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:31.163652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:31.168821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451f11e-8f4f-4a20-92cb-a959cc22b8b8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:31.169227 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451f11e-8f4f-4a20-92cb-a959cc22b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:31.169388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451f11e-8f4f-4a20-92cb-a959cc22b8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:31.187195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d451f11e-8f4f-4a20-92cb-a959cc22b8b8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:31.188426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d451f11e-8f4f-4a20-92cb-a959cc22b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:31.196610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:31.231851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b435e1-9b44-4231-9f6f-66a85b9146ad None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:31.242933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b435e1-9b44-4231-9f6f-66a85b9146ad None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:31.246431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970fc8-5ffb-4f7d-926f-ad7753b0de24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:31.247058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970fc8-5ffb-4f7d-926f-ad7753b0de24 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:31.247382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970fc8-5ffb-4f7d-926f-ad7753b0de24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:31.247684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970fc8-5ffb-4f7d-926f-ad7753b0de24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:31.256911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970fc8-5ffb-4f7d-926f-ad7753b0de24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:31.258331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970fc8-5ffb-4f7d-926f-ad7753b0de24 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:31.267541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 734/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:33.269598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d05eba-7f78-4cfd-9532-2b16d5024ab9 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:33.270628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d05eba-7f78-4cfd-9532-2b16d5024ab9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:33.270724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d05eba-7f78-4cfd-9532-2b16d5024ab9 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:33.272077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:33.277154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d371a-c7ef-432c-8b5e-4555aecf5f49 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:33.277548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d371a-c7ef-432c-8b5e-4555aecf5f49 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:33.277716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d371a-c7ef-432c-8b5e-4555aecf5f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:33.295386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d73d371a-c7ef-432c-8b5e-4555aecf5f49 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:33.296560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d73d371a-c7ef-432c-8b5e-4555aecf5f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:33.304228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:33.340136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d05eba-7f78-4cfd-9532-2b16d5024ab9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:33.351145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d05eba-7f78-4cfd-9532-2b16d5024ab9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:33.354628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a74fd-25af-42f3-b7e9-ef6a65827610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:33.355293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a74fd-25af-42f3-b7e9-ef6a65827610 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:33.355584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a74fd-25af-42f3-b7e9-ef6a65827610 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:33.355860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a74fd-25af-42f3-b7e9-ef6a65827610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:33.364584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a74fd-25af-42f3-b7e9-ef6a65827610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:33.366091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a74fd-25af-42f3-b7e9-ef6a65827610 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:33.375300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 735/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:43.290396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=11 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:43.371111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=14 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:53.119062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e4f0e-7f46-4f21-805e-0c66a82dcf2a None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:53.119660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e4f0e-7f46-4f21-805e-0c66a82dcf2a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:53.119660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e4f0e-7f46-4f21-805e-0c66a82dcf2a None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:53.121024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 736/1471] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:53.126342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18192e73-ebd1-4a74-a00f-801e9e3b8bdc None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:53.126768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18192e73-ebd1-4a74-a00f-801e9e3b8bdc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:53.126935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18192e73-ebd1-4a74-a00f-801e9e3b8bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:53.144701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-18192e73-ebd1-4a74-a00f-801e9e3b8bdc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:53.145892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-18192e73-ebd1-4a74-a00f-801e9e3b8bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:53.153668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 736/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:53.201323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e110-5d40-4f48-9a5c-dd1572364acf None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:53.201617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e110-5d40-4f48-9a5c-dd1572364acf None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:53.201900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e110-5d40-4f48-9a5c-dd1572364acf None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:53.203282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 737/1473] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jun 23 13:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:53.207988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acb913-01fc-4a6c-a148-33e71068709f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:53.208281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acb913-01fc-4a6c-a148-33e71068709f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:53.208559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acb913-01fc-4a6c-a148-33e71068709f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:53.226723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-35acb913-01fc-4a6c-a148-33e71068709f None None] MFA Rules not processed for user `e54dc244053a4253aa32f1eebd655589`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:53.227933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-35acb913-01fc-4a6c-a148-33e71068709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:53.234225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 737/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jun 23 13:40:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:53.241813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6e110-5d40-4f48-9a5c-dd1572364acf None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:53.252924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6e110-5d40-4f48-9a5c-dd1572364acf None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:53.256737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06652f-c72b-41a8-a8a8-036993e4e936 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:53.257363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06652f-c72b-41a8-a8a8-036993e4e936 service glance] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:53.257648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06652f-c72b-41a8-a8a8-036993e4e936 service glance] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:53.257926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06652f-c72b-41a8-a8a8-036993e4e936 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:53.266951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06652f-c72b-41a8-a8a8-036993e4e936 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:53.268424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06652f-c72b-41a8-a8a8-036993e4e936 service glance] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:53.278399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 738/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:55.365054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675bb05-a07f-46fd-aa8c-e2ad3575b532 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:55.365632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675bb05-a07f-46fd-aa8c-e2ad3575b532 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:55.365632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675bb05-a07f-46fd-aa8c-e2ad3575b532 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:55.366986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 738/1476] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:55.371938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4002d-70d4-454c-b665-1d6313b534a0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:55.372345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4002d-70d4-454c-b665-1d6313b534a0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:55.372524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4002d-70d4-454c-b665-1d6313b534a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:55.390209 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-fdd4002d-70d4-454c-b665-1d6313b534a0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:55.391431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-fdd4002d-70d4-454c-b665-1d6313b534a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:55.400001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 739/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:40:55.422399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675bb05-a07f-46fd-aa8c-e2ad3575b532 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:55.434580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675bb05-a07f-46fd-aa8c-e2ad3575b532 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:55.438942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f2608-c366-49b4-a020-98953d3e5aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:55.439606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2608-c366-49b4-a020-98953d3e5aef admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:55.439893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2608-c366-49b4-a020-98953d3e5aef admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:55.440168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2608-c366-49b4-a020-98953d3e5aef admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:55.440888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f2608-c366-49b4-a020-98953d3e5aef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:55.443183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-e19f2608-c366-49b4-a020-98953d3e5aef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:40:55.443183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:40:55.443183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:40:55.444315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f2608-c366-49b4-a020-98953d3e5aef admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:55.463835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 739/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 23 13:40:55 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:40:57.484473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc5464-1163-40a5-b755-d37bf093c487 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:57.485032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc5464-1163-40a5-b755-d37bf093c487 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:57.485032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc5464-1163-40a5-b755-d37bf093c487 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:57.486403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 740/1479] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:57.491737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276252a-53f2-4d55-8000-f680b0122787 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:57.492223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276252a-53f2-4d55-8000-f680b0122787 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:57.492333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276252a-53f2-4d55-8000-f680b0122787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:57.510211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5276252a-53f2-4d55-8000-f680b0122787 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:57.511442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5276252a-53f2-4d55-8000-f680b0122787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:57.519348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 740/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:57.561378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc5464-1163-40a5-b755-d37bf093c487 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:57.575639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc5464-1163-40a5-b755-d37bf093c487 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:57.581070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002617c-10f2-4bf5-b11f-f95cd3ff2273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:57.581713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002617c-10f2-4bf5-b11f-f95cd3ff2273 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:57.582551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002617c-10f2-4bf5-b11f-f95cd3ff2273 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:57.582832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002617c-10f2-4bf5-b11f-f95cd3ff2273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:57.590932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002617c-10f2-4bf5-b11f-f95cd3ff2273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:57.592570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002617c-10f2-4bf5-b11f-f95cd3ff2273 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:57.601762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 741/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:40:59.820222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2f43-5840-45f8-8567-cd21d3ae76bc None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:59.820768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2f43-5840-45f8-8567-cd21d3ae76bc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:59.820768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2f43-5840-45f8-8567-cd21d3ae76bc None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:59.822178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 741/1482] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:40:59.827224 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414799e-fc0c-4045-bd69-b71f2d0770a1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:59.827663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414799e-fc0c-4045-bd69-b71f2d0770a1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:59.827793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414799e-fc0c-4045-bd69-b71f2d0770a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:59.845809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6414799e-fc0c-4045-bd69-b71f2d0770a1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:40:59.847006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6414799e-fc0c-4045-bd69-b71f2d0770a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:40:59.854889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 742/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:40:59.891640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2f43-5840-45f8-8567-cd21d3ae76bc None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:40:59.903032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2f43-5840-45f8-8567-cd21d3ae76bc None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:40:59.906452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d4124-974f-4b8c-b7db-c5e03aa0e0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:40:59.907077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d4124-974f-4b8c-b7db-c5e03aa0e0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:40:59.907403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d4124-974f-4b8c-b7db-c5e03aa0e0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:40:59.907681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d4124-974f-4b8c-b7db-c5e03aa0e0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:40:59.916326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d4124-974f-4b8c-b7db-c5e03aa0e0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:40:59.917744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d4124-974f-4b8c-b7db-c5e03aa0e0e3 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:40:59.926836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 742/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:01.974796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa8a6d-442f-4142-9025-9c8c1f64d886 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:01.975346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa8a6d-442f-4142-9025-9c8c1f64d886 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:01.975443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa8a6d-442f-4142-9025-9c8c1f64d886 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:01.976822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 743/1485] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:41:01.982106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea97a6-5ca3-4d52-902e-32b982c5a36f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:01.982505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea97a6-5ca3-4d52-902e-32b982c5a36f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:01.982668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea97a6-5ca3-4d52-902e-32b982c5a36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:02.000561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-49ea97a6-5ca3-4d52-902e-32b982c5a36f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:02.001751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-49ea97a6-5ca3-4d52-902e-32b982c5a36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:02.010148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 743/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:02.049306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa8a6d-442f-4142-9025-9c8c1f64d886 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:02.060421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa8a6d-442f-4142-9025-9c8c1f64d886 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:02.063949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451889-505b-49c4-a589-26ac33eab2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:02.064588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451889-505b-49c4-a589-26ac33eab2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:02.064868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451889-505b-49c4-a589-26ac33eab2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:02.065142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451889-505b-49c4-a589-26ac33eab2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:02.073785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451889-505b-49c4-a589-26ac33eab2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:02.075229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451889-505b-49c4-a589-26ac33eab2e6 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:02.084291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 744/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:04.190775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fe14-ddad-4b0c-a624-75d5f394bf1a None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.191354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fe14-ddad-4b0c-a624-75d5f394bf1a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.191354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fe14-ddad-4b0c-a624-75d5f394bf1a None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.192688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 744/1488] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:41:04.197889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c790-220c-415d-a2c9-207bad4d480f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.198292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c790-220c-415d-a2c9-207bad4d480f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.198448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c790-220c-415d-a2c9-207bad4d480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.216474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d261c790-220c-415d-a2c9-207bad4d480f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:04.217672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d261c790-220c-415d-a2c9-207bad4d480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:04.226023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 745/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:04.266166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0fe14-ddad-4b0c-a624-75d5f394bf1a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:04.277430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0fe14-ddad-4b0c-a624-75d5f394bf1a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:04.280875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9213694-65fe-4a4e-8b54-85f5ebc3bd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:04.281512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213694-65fe-4a4e-8b54-85f5ebc3bd46 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:04.281801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213694-65fe-4a4e-8b54-85f5ebc3bd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:04.282096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213694-65fe-4a4e-8b54-85f5ebc3bd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:04.290761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9213694-65fe-4a4e-8b54-85f5ebc3bd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:04.292225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9213694-65fe-4a4e-8b54-85f5ebc3bd46 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:04.301372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 745/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:06.537146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a66a-ae9a-414a-83ae-1ff2b88d0201 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.537672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a66a-ae9a-414a-83ae-1ff2b88d0201 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.537785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a66a-ae9a-414a-83ae-1ff2b88d0201 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.539087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 746/1491] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 23 13:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:41:06.544101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1775b-dd10-4014-92ed-3f360627e15e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.544536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1775b-dd10-4014-92ed-3f360627e15e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.544685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1775b-dd10-4014-92ed-3f360627e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.562771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8db1775b-dd10-4014-92ed-3f360627e15e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:41:06.563997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8db1775b-dd10-4014-92ed-3f360627e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:41:06.572145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 746/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 23 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:41:06.611772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8a66a-ae9a-414a-83ae-1ff2b88d0201 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:41:06.623526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8a66a-ae9a-414a-83ae-1ff2b88d0201 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:41:06.627099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a94fd-a9d2-42fb-8023-b5baa9469d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:41:06.627764 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a94fd-a9d2-42fb-8023-b5baa9469d8a service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:41:06.628080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a94fd-a9d2-42fb-8023-b5baa9469d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:41:06.628407 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a94fd-a9d2-42fb-8023-b5baa9469d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:41:06.637799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a94fd-a9d2-42fb-8023-b5baa9469d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:41:06.639402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a94fd-a9d2-42fb-8023-b5baa9469d8a service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:41:06.649620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 747/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:41:16.557502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=33 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:16.645199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=33 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:37.093553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad1fd6-ec16-4d7e-9d7a-7cd5470629e7 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.094178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad1fd6-ec16-4d7e-9d7a-7cd5470629e7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.094178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad1fd6-ec16-4d7e-9d7a-7cd5470629e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.112408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f5ad1fd6-ec16-4d7e-9d7a-7cd5470629e7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:37.113583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f5ad1fd6-ec16-4d7e-9d7a-7cd5470629e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:37.121153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 747/1494] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:37.130285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902440-10ac-4711-a5ba-2ffae1737c87 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.130760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902440-10ac-4711-a5ba-2ffae1737c87 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.130863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902440-10ac-4711-a5ba-2ffae1737c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.148875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-58902440-10ac-4711-a5ba-2ffae1737c87 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:37.150041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-58902440-10ac-4711-a5ba-2ffae1737c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:37.157606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 748/1495] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:37.162578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad1fd6-ec16-4d7e-9d7a-7cd5470629e7 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.172059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad1fd6-ec16-4d7e-9d7a-7cd5470629e7 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.176576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.177221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.177505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.177789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.178511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:42:37.178822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.179878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:37.179878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:42:37.179878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:42:37.180757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.191974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 748/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:42:37.199608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902440-10ac-4711-a5ba-2ffae1737c87 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.209135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902440-10ac-4711-a5ba-2ffae1737c87 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.213589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.214232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.214508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.214783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.215511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.217274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING py.warnings [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:37.217274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: warnings.warn(msg) Jun 23 13:42:37.217274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: Jun 23 13:42:37.218465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.256197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 749/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:42:37 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:37.258950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.271509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33e52-906f-4795-9d89-eaf398c9ac67 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.326901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.327596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.327888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.328184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.328854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.330516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:37.330516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:42:37.330516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:42:37.331764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.351066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 749/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:42:37 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:42:37.355113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.365304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37816a9-89ef-447b-afba-90eb3a7115a6 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.370005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.370705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.371033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.371351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.372081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.373130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING py.warnings [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:37.373130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: warnings.warn(msg) Jun 23 13:42:37.373130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: Jun 23 13:42:37.374060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.387958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 750/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:37.391264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.401930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009762a-fbd0-42a1-b91b-f688ebf71531 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.406486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d527e-489b-4159-ba1e-f4c33b175b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.407139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d527e-489b-4159-ba1e-f4c33b175b2a admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.407454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d527e-489b-4159-ba1e-f4c33b175b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.407734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d527e-489b-4159-ba1e-f4c33b175b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.408473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d527e-489b-4159-ba1e-f4c33b175b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.409469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-a87d527e-489b-4159-ba1e-f4c33b175b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:37.409469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:42:37.409469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:42:37.410348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d527e-489b-4159-ba1e-f4c33b175b2a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.423312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 750/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:42:37.427340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.437158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b72f4-b239-43a4-b923-aff0c41317e7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.442192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b88c1-e50c-4ea6-81dc-bbea7b0d22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.443123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b88c1-e50c-4ea6-81dc-bbea7b0d22e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.443457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b88c1-e50c-4ea6-81dc-bbea7b0d22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.443766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b88c1-e50c-4ea6-81dc-bbea7b0d22e7 admin admin] PATH_INFO: `/v3/projects/7fda470a6f1443c983a0009e434f5449/users/b845902675e045b0a914873ddee7c405/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.458989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b88c1-e50c-4ea6-81dc-bbea7b0d22e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fda470a6f1443c983a0009e434f5449, user_id=b845902675e045b0a914873ddee7c405, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.460060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING py.warnings [None req-d21b88c1-e50c-4ea6-81dc-bbea7b0d22e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:37.460060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: warnings.warn(msg) Jun 23 13:42:37.460060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: Jun 23 13:42:37.462007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b88c1-e50c-4ea6-81dc-bbea7b0d22e7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.475839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 751/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:42:37 2022] PUT /identity/v3/projects/7fda470a6f1443c983a0009e434f5449/users/b845902675e045b0a914873ddee7c405/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:37.487145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ad9e-3185-4717-89ab-8ecfa1582636 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.487495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ad9e-3185-4717-89ab-8ecfa1582636 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.487780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ad9e-3185-4717-89ab-8ecfa1582636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.515072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2c13ad9e-3185-4717-89ab-8ecfa1582636 None None] MFA Rules not processed for user `b845902675e045b0a914873ddee7c405`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:37.516322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2c13ad9e-3185-4717-89ab-8ecfa1582636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:37.577760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 751/1502] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:37.591579 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a03e-9404-4753-b6d4-b0dd87fd1226 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.591873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a03e-9404-4753-b6d4-b0dd87fd1226 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.592154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a03e-9404-4753-b6d4-b0dd87fd1226 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.593505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 752/1503] 10.222.0.23 () {54 vars in 963 bytes} [Thu Jun 23 13:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:42:37.598471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd88d1-aba7-46ec-9fda-beb35da18427 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.598763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd88d1-aba7-46ec-9fda-beb35da18427 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.599044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd88d1-aba7-46ec-9fda-beb35da18427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.616382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5ffd88d1-aba7-46ec-9fda-beb35da18427 None None] MFA Rules not processed for user `f98ec37cbc1f4da88cc2d7887b26aa41`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:37.617495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5ffd88d1-aba7-46ec-9fda-beb35da18427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:37.660741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:37.669373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 752/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Jun 23 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:42:37.677447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a03e-9404-4753-b6d4-b0dd87fd1226 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.687724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a03e-9404-4753-b6d4-b0dd87fd1226 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.691771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.692397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.692679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.692973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.700985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.702379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.711002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 753/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:42:37.751630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c990b-9287-4ff4-85bf-7e4c11783618 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.752500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c990b-9287-4ff4-85bf-7e4c11783618 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.752781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c990b-9287-4ff4-85bf-7e4c11783618 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.754086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 753/1506] 10.222.0.23 () {52 vars in 829 bytes} [Thu Jun 23 13:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:42:37.757699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:37.818573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2d38-cfc2-410e-b798-9ca651ce5a3e service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:37.823014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:37.823911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.824200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.824483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] PATH_INFO: `/v3/users/b845902675e045b0a914873ddee7c405` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.825647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b845902675e045b0a914873ddee7c405)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:37.826652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING py.warnings [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:37.826652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: warnings.warn(msg) Jun 23 13:42:37.826652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: Jun 23 13:42:37.827908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:37.890605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b845902675e045b0a914873ddee7c405'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:37.911137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b845902675e045b0a914873ddee7c405'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:37.911903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b845902675e045b0a914873ddee7c405'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:37.921230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b845902675e045b0a914873ddee7c405'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:37.933003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:37.938313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b845902675e045b0a914873ddee7c405'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:37.946504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 754/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:42:37 2022] DELETE /identity/v3/users/b845902675e045b0a914873ddee7c405 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:42:37.951108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:37.951460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:37.951743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:37.968601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:42:37.969786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:38.026510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 754/1508] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:42:38.036411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:38.037838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:38.093453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe532-59ba-4dd5-b5c9-e2da041b31d8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:38.097584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5ccf1-05a9-4378-b805-5e342f6aed0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:38.098233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5ccf1-05a9-4378-b805-5e342f6aed0e service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:38.098521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5ccf1-05a9-4378-b805-5e342f6aed0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:38.098802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5ccf1-05a9-4378-b805-5e342f6aed0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:38.107538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5ccf1-05a9-4378-b805-5e342f6aed0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:38.108966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5ccf1-05a9-4378-b805-5e342f6aed0e service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:38.118700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 755/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:42:38.437584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:42:38.439270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:42:38.451505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c959-c825-4ce3-82c8-e059c27e4c6f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:42:38.456814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:42:38.457680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:42:38.457969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:42:38.458300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] PATH_INFO: `/v3/projects/7fda470a6f1443c983a0009e434f5449` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:42:38.459511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fda470a6f1443c983a0009e434f5449)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:42:38.460570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:42:38.460570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:42:38.460570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:42:38.463874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:42:38.530163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fda470a6f1443c983a0009e434f5449', 'request_id': 'req-94a0682e-ce22-48c0-a74b-a7b7e52c7852'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:38.544945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fda470a6f1443c983a0009e434f5449', 'request_id': 'req-94a0682e-ce22-48c0-a74b-a7b7e52c7852'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:38.554774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fda470a6f1443c983a0009e434f5449', 'request_id': 'req-94a0682e-ce22-48c0-a74b-a7b7e52c7852'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:38.566007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] The token cache is being invalidate because project 7fda470a6f1443c983a0009e434f5449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:42:38.566302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:38.566934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-94a0682e-ce22-48c0-a74b-a7b7e52c7852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:42:38.568684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 755/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:42:38 2022] DELETE /identity/v3/projects/7fda470a6f1443c983a0009e434f5449 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:42:48.114663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=29 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:48.562846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:20.898921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf9e0f-4e9c-4b39-99cb-c85a275146ea None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:20.899616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf9e0f-4e9c-4b39-99cb-c85a275146ea None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:20.899616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf9e0f-4e9c-4b39-99cb-c85a275146ea None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:20.900909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:20.905630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09425fd3-a2e8-41df-a5e4-ac8a13d3c1a7 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:20.906126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09425fd3-a2e8-41df-a5e4-ac8a13d3c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:20.906231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09425fd3-a2e8-41df-a5e4-ac8a13d3c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:20.924202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-09425fd3-a2e8-41df-a5e4-ac8a13d3c1a7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:20.925412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-09425fd3-a2e8-41df-a5e4-ac8a13d3c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:20.981883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:21.135736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf9e0f-4e9c-4b39-99cb-c85a275146ea None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:21.137456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-95bf9e0f-4e9c-4b39-99cb-c85a275146ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:21.211112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf9e0f-4e9c-4b39-99cb-c85a275146ea None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:21.216326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc8e4-4ceb-49e9-ab37-6410418c6d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:21.216968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc8e4-4ceb-49e9-ab37-6410418c6d58 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:21.217260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc8e4-4ceb-49e9-ab37-6410418c6d58 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:21.217544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc8e4-4ceb-49e9-ab37-6410418c6d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:21.225396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc8e4-4ceb-49e9-ab37-6410418c6d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:21.226962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc8e4-4ceb-49e9-ab37-6410418c6d58 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:21.236648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 757/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:22.058372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9bab-1a9d-4220-ac5f-b0f682fab34d None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:22.058923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9bab-1a9d-4220-ac5f-b0f682fab34d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:22.058923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9bab-1a9d-4220-ac5f-b0f682fab34d None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:22.060352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:22.065696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2ebf2-56cf-4cb9-97a1-978baa76d31d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:22.066110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2ebf2-56cf-4cb9-97a1-978baa76d31d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:22.066261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2ebf2-56cf-4cb9-97a1-978baa76d31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:22.083998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d8b2ebf2-56cf-4cb9-97a1-978baa76d31d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:22.085192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d8b2ebf2-56cf-4cb9-97a1-978baa76d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:22.092936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:22.245354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9bab-1a9d-4220-ac5f-b0f682fab34d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:22.259624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9bab-1a9d-4220-ac5f-b0f682fab34d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:22.265029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e1ffc-801b-4c98-8615-995893738aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:22.265710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e1ffc-801b-4c98-8615-995893738aaa service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:22.266067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e1ffc-801b-4c98-8615-995893738aaa service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:22.266384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e1ffc-801b-4c98-8615-995893738aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:22.274782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e1ffc-801b-4c98-8615-995893738aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:22.276401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e1ffc-801b-4c98-8615-995893738aaa service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:22.286589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 758/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:22.363691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcae15-745c-4c40-9931-64dcb8f2a169 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:22.363983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcae15-745c-4c40-9931-64dcb8f2a169 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:22.364265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcae15-745c-4c40-9931-64dcb8f2a169 None None] PATH_INFO: `/v3` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:22.365631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 759/1517] 10.222.0.13 () {54 vars in 925 bytes} [Thu Jun 23 13:44:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:44:22.371686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feede4-3bed-4265-b178-e63061a0343d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:22.371976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feede4-3bed-4265-b178-e63061a0343d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:22.372471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feede4-3bed-4265-b178-e63061a0343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:22.390613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-13feede4-3bed-4265-b178-e63061a0343d None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:22.391851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-13feede4-3bed-4265-b178-e63061a0343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:22.455790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 759/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 23 13:44:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:26.194685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dec9c-9d98-48d0-9e7d-c1fe733ff51b None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:26.195270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dec9c-9d98-48d0-9e7d-c1fe733ff51b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:26.195270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dec9c-9d98-48d0-9e7d-c1fe733ff51b None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:26.196644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 760/1519] 10.222.0.23 () {54 vars in 960 bytes} [Thu Jun 23 13:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:26.201438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c27a72-5b1d-4b77-a094-df0f163577f2 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:26.201818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c27a72-5b1d-4b77-a094-df0f163577f2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:26.201998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c27a72-5b1d-4b77-a094-df0f163577f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:26.220037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c0c27a72-5b1d-4b77-a094-df0f163577f2 None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:26.221237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c0c27a72-5b1d-4b77-a094-df0f163577f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:26.229540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 760/1520] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Jun 23 13:44:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:26.237397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dec9c-9d98-48d0-9e7d-c1fe733ff51b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:26.250263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dec9c-9d98-48d0-9e7d-c1fe733ff51b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:26.255100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e74d-240a-49ea-904a-3fbbc794ef87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:26.255747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e74d-240a-49ea-904a-3fbbc794ef87 service placement] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:26.256033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e74d-240a-49ea-904a-3fbbc794ef87 service placement] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:26.256315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e74d-240a-49ea-904a-3fbbc794ef87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:26.264524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e74d-240a-49ea-904a-3fbbc794ef87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:26.267345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e74d-240a-49ea-904a-3fbbc794ef87 service placement] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:26.277589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 761/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:44:33.505796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7904b1-7f31-4d02-bd44-8a4b33dc022d None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:33.506246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7904b1-7f31-4d02-bd44-8a4b33dc022d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:33.506367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7904b1-7f31-4d02-bd44-8a4b33dc022d None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:33.507939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:33.512669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8e74-d5c8-4b07-978e-b53c4024dfb4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:33.513097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8e74-d5c8-4b07-978e-b53c4024dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:33.513240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8e74-d5c8-4b07-978e-b53c4024dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:33.531733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-a08f8e74-d5c8-4b07-978e-b53c4024dfb4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:33.532923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a08f8e74-d5c8-4b07-978e-b53c4024dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:33.540653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:33.695353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7904b1-7f31-4d02-bd44-8a4b33dc022d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:33.709469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7904b1-7f31-4d02-bd44-8a4b33dc022d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:33.715005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda4559-053e-4cf4-b6ea-a4b144a9e24e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:33.715682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4559-053e-4cf4-b6ea-a4b144a9e24e service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:33.715967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4559-053e-4cf4-b6ea-a4b144a9e24e service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:33.716246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4559-053e-4cf4-b6ea-a4b144a9e24e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:33.724955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda4559-053e-4cf4-b6ea-a4b144a9e24e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:33.726544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda4559-053e-4cf4-b6ea-a4b144a9e24e service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:33.736349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 762/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:34.554063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204760e1-1747-48c6-8a27-249af6b66ac4 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:34.554564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204760e1-1747-48c6-8a27-249af6b66ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:34.554675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204760e1-1747-48c6-8a27-249af6b66ac4 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:34.556041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:34.560872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed486-89b8-4a06-bcfd-59f7c51218a9 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:34.561317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed486-89b8-4a06-bcfd-59f7c51218a9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:34.561413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed486-89b8-4a06-bcfd-59f7c51218a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:34.583042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-170ed486-89b8-4a06-bcfd-59f7c51218a9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:34.584277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-170ed486-89b8-4a06-bcfd-59f7c51218a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:34.592228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:34.746948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204760e1-1747-48c6-8a27-249af6b66ac4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:34.761066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204760e1-1747-48c6-8a27-249af6b66ac4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:34.767073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89443e-67c2-4817-bc20-150e87b32385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:34.767765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89443e-67c2-4817-bc20-150e87b32385 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:34.768051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89443e-67c2-4817-bc20-150e87b32385 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:34.768330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89443e-67c2-4817-bc20-150e87b32385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:34.776699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89443e-67c2-4817-bc20-150e87b32385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:34.778264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89443e-67c2-4817-bc20-150e87b32385 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:34.788010 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 764/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:38.668249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04613c-8950-4c3c-b6f7-723f3208ea5c None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:38.668818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04613c-8950-4c3c-b6f7-723f3208ea5c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:38.668818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04613c-8950-4c3c-b6f7-723f3208ea5c None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:38.670176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:38.675593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8827b5-119d-4f44-bd92-458e22cd320c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:38.676034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8827b5-119d-4f44-bd92-458e22cd320c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:38.676141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8827b5-119d-4f44-bd92-458e22cd320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:38.695626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-da8827b5-119d-4f44-bd92-458e22cd320c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:38.696816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-da8827b5-119d-4f44-bd92-458e22cd320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:38.704945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:38.741486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04613c-8950-4c3c-b6f7-723f3208ea5c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:38.743139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4b04613c-8950-4c3c-b6f7-723f3208ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:38.799164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04613c-8950-4c3c-b6f7-723f3208ea5c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:38.802711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925fa2-f617-43b7-aa62-79d9a7573411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:38.803387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925fa2-f617-43b7-aa62-79d9a7573411 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:38.803678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925fa2-f617-43b7-aa62-79d9a7573411 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:38.803975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925fa2-f617-43b7-aa62-79d9a7573411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:38.813413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925fa2-f617-43b7-aa62-79d9a7573411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:38.814848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925fa2-f617-43b7-aa62-79d9a7573411 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:38.819792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:38.824712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 765/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:40.896903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7bd14-586e-40c0-802b-b38f0b484786 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:40.897461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7bd14-586e-40c0-802b-b38f0b484786 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:40.897573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7bd14-586e-40c0-802b-b38f0b484786 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:40.898866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:40.903900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688c13-a9ce-406b-a245-c745c369e843 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:40.904310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688c13-a9ce-406b-a245-c745c369e843 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:40.904462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688c13-a9ce-406b-a245-c745c369e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:40.923178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1e688c13-a9ce-406b-a245-c745c369e843 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:40.924391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1e688c13-a9ce-406b-a245-c745c369e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:40.932000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:40.967411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7bd14-586e-40c0-802b-b38f0b484786 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:40.977976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7bd14-586e-40c0-802b-b38f0b484786 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:40.981424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11635a-266b-4f73-b7b4-d566101d303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:40.982058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11635a-266b-4f73-b7b4-d566101d303a service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:40.982344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11635a-266b-4f73-b7b4-d566101d303a service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:40.982623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11635a-266b-4f73-b7b4-d566101d303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:40.991823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11635a-266b-4f73-b7b4-d566101d303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:40.993254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11635a-266b-4f73-b7b4-d566101d303a service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:41.003123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 767/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:44.380494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6cd0a-edb9-4879-bf2e-950b510325a2 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:44.381032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6cd0a-edb9-4879-bf2e-950b510325a2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:44.381032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6cd0a-edb9-4879-bf2e-950b510325a2 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:44.382414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:44.387499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706100f4-6f04-42ff-b87a-3fa6313cebba None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:44.387900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706100f4-6f04-42ff-b87a-3fa6313cebba None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:44.388088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706100f4-6f04-42ff-b87a-3fa6313cebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:44.406820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-706100f4-6f04-42ff-b87a-3fa6313cebba None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:44.408089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-706100f4-6f04-42ff-b87a-3fa6313cebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:44.415829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:44.713229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6cd0a-edb9-4879-bf2e-950b510325a2 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:44.714868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d7f6cd0a-edb9-4879-bf2e-950b510325a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:44.770551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6cd0a-edb9-4879-bf2e-950b510325a2 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:44.774285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544ff7f-2f11-432a-86c4-92188ff6cb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:44.774919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ff7f-2f11-432a-86c4-92188ff6cb8d service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:44.775216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ff7f-2f11-432a-86c4-92188ff6cb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:44.775509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ff7f-2f11-432a-86c4-92188ff6cb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:44.784226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544ff7f-2f11-432a-86c4-92188ff6cb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:44.785647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544ff7f-2f11-432a-86c4-92188ff6cb8d service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:44.794699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 768/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:46.827088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc960aa-245b-4a9e-82f2-22be5f6a279f None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:46.827674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc960aa-245b-4a9e-82f2-22be5f6a279f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:46.827674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc960aa-245b-4a9e-82f2-22be5f6a279f None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:46.829061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:44:46.834169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff38bf7-c7fa-42c4-ac00-99bb73034ab1 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:46.834592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff38bf7-c7fa-42c4-ac00-99bb73034ab1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:46.834728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff38bf7-c7fa-42c4-ac00-99bb73034ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:46.852426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3ff38bf7-c7fa-42c4-ac00-99bb73034ab1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:44:46.853620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3ff38bf7-c7fa-42c4-ac00-99bb73034ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:46.861806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:44:47.158682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc960aa-245b-4a9e-82f2-22be5f6a279f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:44:47.160386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ffc960aa-245b-4a9e-82f2-22be5f6a279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:44:47.173819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc960aa-245b-4a9e-82f2-22be5f6a279f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:44:47.177542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fac33-e6c4-40fe-b2f3-69c5e96eebbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:44:47.178204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fac33-e6c4-40fe-b2f3-69c5e96eebbc service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:44:47.178492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fac33-e6c4-40fe-b2f3-69c5e96eebbc service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:44:47.178798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fac33-e6c4-40fe-b2f3-69c5e96eebbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:44:47.187632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fac33-e6c4-40fe-b2f3-69c5e96eebbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:44:47.189056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fac33-e6c4-40fe-b2f3-69c5e96eebbc service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:44:47.198220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 770/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:44:56.847235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=32 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:57.194246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=70 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:18.117818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c41d-d8f0-422c-b8f6-b74df2397d51 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.118938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c41d-d8f0-422c-b8f6-b74df2397d51 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.119597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c41d-d8f0-422c-b8f6-b74df2397d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.143176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f498c41d-d8f0-422c-b8f6-b74df2397d51 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.144824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f498c41d-d8f0-422c-b8f6-b74df2397d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.158913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 770/1540] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:18.170890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c791-3df7-4800-820f-5495d64c1634 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.171520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c791-3df7-4800-820f-5495d64c1634 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.171520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c791-3df7-4800-820f-5495d64c1634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.200462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-7ea1c791-3df7-4800-820f-5495d64c1634 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.202246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7ea1c791-3df7-4800-820f-5495d64c1634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.220926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 771/1541] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.226010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498c41d-d8f0-422c-b8f6-b74df2397d51 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.237286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498c41d-d8f0-422c-b8f6-b74df2397d51 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.248717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf486af-ccba-4765-9155-113834e87c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.249756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf486af-ccba-4765-9155-113834e87c53 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.250251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf486af-ccba-4765-9155-113834e87c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.250737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf486af-ccba-4765-9155-113834e87c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.251721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf486af-ccba-4765-9155-113834e87c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:18.252254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf486af-ccba-4765-9155-113834e87c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.255176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf486af-ccba-4765-9155-113834e87c53 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.278251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 771/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:18.287021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1c791-3df7-4800-820f-5495d64c1634 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.301308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1c791-3df7-4800-820f-5495d64c1634 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.316062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.316771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.317063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.317350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.318079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.320117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.355743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d4fef-100c-49c3-a359-360f1ea8a5ac None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.356163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d4fef-100c-49c3-a359-360f1ea8a5ac None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.356513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d4fef-100c-49c3-a359-360f1ea8a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.364122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 772/1543] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:18.368617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.397830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-df4d4fef-100c-49c3-a359-360f1ea8a5ac None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.399194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-df4d4fef-100c-49c3-a359-360f1ea8a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.509359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 772/1544] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:18.510862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a1a5-20be-4758-a949-472c1bd6093e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.511170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a1a5-20be-4758-a949-472c1bd6093e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.511479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a1a5-20be-4758-a949-472c1bd6093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.541250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b297a1a5-20be-4758-a949-472c1bd6093e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.542398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b297a1a5-20be-4758-a949-472c1bd6093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.551060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5434a8-e009-4454-a4e5-ec8cb9152cbd admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.569021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f110ab5-5f27-4385-a03b-2c0d6ae07a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.569722 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f110ab5-5f27-4385-a03b-2c0d6ae07a52 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.570015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f110ab5-5f27-4385-a03b-2c0d6ae07a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.570302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f110ab5-5f27-4385-a03b-2c0d6ae07a52 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.571016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f110ab5-5f27-4385-a03b-2c0d6ae07a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.572090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING py.warnings [None req-7f110ab5-5f27-4385-a03b-2c0d6ae07a52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:46:18.572090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: warnings.warn(msg) Jun 23 13:46:18.572090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: Jun 23 13:46:18.573308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f110ab5-5f27-4385-a03b-2c0d6ae07a52 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.577162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 773/1545] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.578604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c49a2-bef9-460c-8096-69b5a5181586 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.578991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c49a2-bef9-460c-8096-69b5a5181586 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.579181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c49a2-bef9-460c-8096-69b5a5181586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.612534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 773/1546] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:18.613771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3b5c49a2-bef9-460c-8096-69b5a5181586 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.614531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58731f2-4cd6-4811-bab3-37365ce44454 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.615184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58731f2-4cd6-4811-bab3-37365ce44454 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.615353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3b5c49a2-bef9-460c-8096-69b5a5181586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.615826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58731f2-4cd6-4811-bab3-37365ce44454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.623359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 774/1547] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.624824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbe56-1fd5-4da3-8072-b06aef18fa75 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.624971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbe56-1fd5-4da3-8072-b06aef18fa75 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.625142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbe56-1fd5-4da3-8072-b06aef18fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.636209 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f58731f2-4cd6-4811-bab3-37365ce44454 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.637419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f58731f2-4cd6-4811-bab3-37365ce44454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.643580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-97bfbe56-1fd5-4da3-8072-b06aef18fa75 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.644757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-97bfbe56-1fd5-4da3-8072-b06aef18fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.645779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 774/1548] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.647558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a6ca-97ea-4c86-8dfc-3f87f9f60ec4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.647854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a6ca-97ea-4c86-8dfc-3f87f9f60ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.648140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a6ca-97ea-4c86-8dfc-3f87f9f60ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.653901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 775/1549] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.656483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a543-f5b2-4882-934e-cf1430d9a01b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.656483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a543-f5b2-4882-934e-cf1430d9a01b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.656483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a543-f5b2-4882-934e-cf1430d9a01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.667175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2692a6ca-97ea-4c86-8dfc-3f87f9f60ec4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.668433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2692a6ca-97ea-4c86-8dfc-3f87f9f60ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.674388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a218a543-f5b2-4882-934e-cf1430d9a01b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.675561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a218a543-f5b2-4882-934e-cf1430d9a01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.677031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 775/1550] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.678198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffd96-5703-429f-a3da-c622441c7635 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.678514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffd96-5703-429f-a3da-c622441c7635 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.678775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffd96-5703-429f-a3da-c622441c7635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.683513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 776/1551] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.684309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a543-f5b2-4882-934e-cf1430d9a01b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.693923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a543-f5b2-4882-934e-cf1430d9a01b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.698561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1b7ac-e908-455f-9052-94c45dc0bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.699235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b7ac-e908-455f-9052-94c45dc0bf83 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.699528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b7ac-e908-455f-9052-94c45dc0bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.699801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b7ac-e908-455f-9052-94c45dc0bf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.700517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1b7ac-e908-455f-9052-94c45dc0bf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.702164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1b7ac-e908-455f-9052-94c45dc0bf83 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.703676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b28ffd96-5703-429f-a3da-c622441c7635 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.704874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b28ffd96-5703-429f-a3da-c622441c7635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.712431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 777/1552] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:18.712992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 776/1553] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.713778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffd96-5703-429f-a3da-c622441c7635 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.714441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca7f2-af0d-4b11-9d2d-def493f9d892 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.714897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca7f2-af0d-4b11-9d2d-def493f9d892 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.715532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca7f2-af0d-4b11-9d2d-def493f9d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.725610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffd96-5703-429f-a3da-c622441c7635 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.730166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.730849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.731138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.731569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.732934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:18.733261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.734285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING py.warnings [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:46:18.734285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: warnings.warn(msg) Jun 23 13:46:18.734285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: Jun 23 13:46:18.734887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-fd3ca7f2-af0d-4b11-9d2d-def493f9d892 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.735182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372f81-dd34-4f16-811e-17ab045a3d0a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.736130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fd3ca7f2-af0d-4b11-9d2d-def493f9d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.744030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 778/1554] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.745311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f8d44-05a5-475a-98cd-bd819d8ccb9b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.745601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f8d44-05a5-475a-98cd-bd819d8ccb9b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.745883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f8d44-05a5-475a-98cd-bd819d8ccb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.746758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 777/1555] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:18.747915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbcce-d659-4570-902f-8bf57c463fe0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.748213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbcce-d659-4570-902f-8bf57c463fe0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.748496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbcce-d659-4570-902f-8bf57c463fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.771431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9c0bbcce-d659-4570-902f-8bf57c463fe0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.771919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1f4f8d44-05a5-475a-98cd-bd819d8ccb9b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.772948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9c0bbcce-d659-4570-902f-8bf57c463fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.773056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1f4f8d44-05a5-475a-98cd-bd819d8ccb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.781472 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 778/1556] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.781628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 779/1557] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.782694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f081-cf27-446a-a05a-6bdf4ab642bd None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.782992 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f081-cf27-446a-a05a-6bdf4ab642bd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.783345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f081-cf27-446a-a05a-6bdf4ab642bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.783699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbcce-d659-4570-902f-8bf57c463fe0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.794414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbcce-d659-4570-902f-8bf57c463fe0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.799424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba22f6-8346-4ce5-9c30-7504ecd9669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.800077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba22f6-8346-4ce5-9c30-7504ecd9669e admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.800358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba22f6-8346-4ce5-9c30-7504ecd9669e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.800636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba22f6-8346-4ce5-9c30-7504ecd9669e admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.801352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba22f6-8346-4ce5-9c30-7504ecd9669e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:18.801657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba22f6-8346-4ce5-9c30-7504ecd9669e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.801792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7f21f081-cf27-446a-a05a-6bdf4ab642bd None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.802890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7f21f081-cf27-446a-a05a-6bdf4ab642bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.803401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba22f6-8346-4ce5-9c30-7504ecd9669e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.810767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 780/1558] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.811588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f081-cf27-446a-a05a-6bdf4ab642bd None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.816051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 779/1559] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:18.817360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9cbe-b1a6-4e4e-9924-f315c49244b3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.817659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9cbe-b1a6-4e4e-9924-f315c49244b3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.817944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9cbe-b1a6-4e4e-9924-f315c49244b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.820910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f081-cf27-446a-a05a-6bdf4ab642bd None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.825554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745651-23da-43cd-a067-b88b54f1d01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.826247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745651-23da-43cd-a067-b88b54f1d01c admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.826535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745651-23da-43cd-a067-b88b54f1d01c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.826812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745651-23da-43cd-a067-b88b54f1d01c admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.827570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35745651-23da-43cd-a067-b88b54f1d01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.829199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35745651-23da-43cd-a067-b88b54f1d01c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.835779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-07fc9cbe-b1a6-4e4e-9924-f315c49244b3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.836978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-07fc9cbe-b1a6-4e4e-9924-f315c49244b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.839048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 781/1560] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:18.840267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45bb8-aa33-40ac-bf2a-891726af4e63 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.840559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45bb8-aa33-40ac-bf2a-891726af4e63 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.840842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45bb8-aa33-40ac-bf2a-891726af4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.849646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 780/1561] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.849646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9cbe-b1a6-4e4e-9924-f315c49244b3 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.856464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9cbe-b1a6-4e4e-9924-f315c49244b3 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.859113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-07f45bb8-aa33-40ac-bf2a-891726af4e63 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:18.860332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-07f45bb8-aa33-40ac-bf2a-891726af4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:18.861765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.862421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.862704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.863009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.863726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.865672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.879176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 782/1562] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:18.880044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f45bb8-aa33-40ac-bf2a-891726af4e63 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.892840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f45bb8-aa33-40ac-bf2a-891726af4e63 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.899581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 781/1563] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:18.899581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.899794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.899794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.899794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.899794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.900114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:18.900189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.901923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.921511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 783/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:18.921511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.926900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc1e6-9f13-4304-8798-0691b2034f16 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.940874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:18.961937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02b0b3-22ac-4651-9dff-c10c8cb16f30 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:18.966470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.967747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.968035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.968312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.969030 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:18.969338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.970943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.975329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:18.982930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 782/1565] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:18.983567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:18.985049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:18.985711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:18.986002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:18.986301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:18.987023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:18.987380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:18.988993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:18.995179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53201a-9244-4b3c-a406-4a2a1506c026 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.000008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.000649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.000817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 784/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:19.000931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.001208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.001592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.001958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.003838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.011149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf083c38-4d51-432a-98de-5c8a172ef7f8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.016750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.017625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.017916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.018194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] PATH_INFO: `/v3/projects/7d15a770ed1e4bd490fcfe4a7adb18d3/users/6777b374897144e599885011d7df3381/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.037349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 783/1567] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:18 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.037549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d15a770ed1e4bd490fcfe4a7adb18d3, user_id=6777b374897144e599885011d7df3381, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.037678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.037772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:46:19.037772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:46:19.037772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:46:19.038610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.061699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 785/1568] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:19 2022] PUT /identity/v3/projects/7d15a770ed1e4bd490fcfe4a7adb18d3/users/6777b374897144e599885011d7df3381/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:19.061699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.110282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a970a1-3837-4e62-a848-dd84a8c4526b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.119266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbfa77-9229-42c5-95e2-5954756172dd admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.123941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.124611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.124901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.125184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.125909 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:19.126225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.127895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.139899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 786/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:19.140498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.150027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc85a2-19ef-4fb4-b7d0-7beaf42c8a82 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.155105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.155773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.156056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.156331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.157031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.158941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.172291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.172946 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.173231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.173539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.174334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:19.174649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.176268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.180158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 787/1570] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/users => generated 294 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.180985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.195761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 784/1571] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:19.195761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.197831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4552ad-4b93-4641-b85c-6c1275e1daa8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.198806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9919b4e-2497-48f9-a92c-d2b03f874d08 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.202835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.203486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.203778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.203988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.204120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.204637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.204745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.204924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.205203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.205914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.206582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.207587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:46:19.207587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:46:19.207587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:46:19.208829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.238337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 785/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.238337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.238633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 788/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.238633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.273017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:19.301977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080945d-24b4-498d-9017-9b67a61f4499 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.304098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ea74-3ed3-474b-9991-6f50badff7d7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.306907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878819-01bc-407a-bb4b-fee91db97e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.307644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878819-01bc-407a-bb4b-fee91db97e64 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.307937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878819-01bc-407a-bb4b-fee91db97e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.308222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878819-01bc-407a-bb4b-fee91db97e64 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.308733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.308913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878819-01bc-407a-bb4b-fee91db97e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.309409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.309693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.309963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.311192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.311450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878819-01bc-407a-bb4b-fee91db97e64 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.313157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.333325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 789/1574] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.334575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157631c-d69b-464c-971d-cf076d7cefbb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.334872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157631c-d69b-464c-971d-cf076d7cefbb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.335153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157631c-d69b-464c-971d-cf076d7cefbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.340236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 786/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.341262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.348015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:19.363782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e157631c-d69b-464c-971d-cf076d7cefbb None None] MFA Rules not processed for user `6777b374897144e599885011d7df3381`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:19.365005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e157631c-d69b-464c-971d-cf076d7cefbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:19.406513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0e671-1ca5-4d8c-863e-dba51529a12e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.411080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.411810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.412107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.412391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.413085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.414994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.432177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 790/1576] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:19.433030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157631c-d69b-464c-971d-cf076d7cefbb None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.446481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 787/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.446664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157631c-d69b-464c-971d-cf076d7cefbb None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.446775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.506670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e5ed3-7266-4a99-970d-e198466d4ba4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.507726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.508410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.508699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.508981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.509711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.511347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.511490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.512008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.512299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.512855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.513635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.516175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.522188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 791/1578] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.522964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.534939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9707eb-04b0-4637-8b17-36e4251a1c0b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.539601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.540246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.540526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.540803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.541475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.542556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 788/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.543386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.543494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.568955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 792/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.568955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.575908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:19.578733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e86f2-3f8d-4285-803c-aa64f1311a69 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.611618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6593988-bec6-4240-a7c1-03dbf2c4e3c9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.616098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.616767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.617051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.617333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.618019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.619961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.636124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.636796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.637079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.637360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.638083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.639710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.642889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 789/1581] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.642889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.652746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 793/1582] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.652746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.652976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404735f-8446-4b60-8955-f7d3091901ee admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.655291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.655968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.656252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.656535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.657212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.659154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.662392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:19.680596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 790/1583] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.682079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.692533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b27c4-ef18-447e-99c6-545e1c92cb2b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.697131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.697765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.698061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.698354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.699039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.701003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.708486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d1630-54a4-4e1d-9159-518a7360cefa admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.713532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.714245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.714697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.715001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.721364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 791/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.722296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.731543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7011-c719-41bc-a1e9-98440515020c admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.737037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.737674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.737959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.738241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.738986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.740591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.751403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 792/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.752280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.761479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a184-24aa-4ff5-b170-051d8058c7fe admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.766018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.766675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.766963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.767287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.767947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.769802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.774384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.775862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.792422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 793/1586] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:19 2022] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:19.792422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.792990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 794/1587] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:19.792990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.804481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58330f70-d910-432c-95b8-16505e4e2db1 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.807519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae96b0-6447-49fe-84f1-f5ccb167f183 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.811188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.812008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.812312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.812743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.813475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.813589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.814341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.814688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.815050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.815145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.815820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.817405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.826032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 795/1588] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.828509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 794/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.829876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.832403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.839988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef9361-8da2-464c-b670-faadbd34c1f5 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.841941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072c845-bc70-47e3-a3c2-84d990656b51 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.844637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.845355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.845652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.845931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.846482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.846900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.847275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.847569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.847870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.848552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.848718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.850269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.863928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 795/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.863928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.864295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 796/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.864295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.874362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fc841-5a74-4a2e-ac0a-a37d38de531d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.875413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff440-281e-4f8e-a32f-ea025f0aab88 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.879313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.880286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.880593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.880732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.880850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] PATH_INFO: `/v3/projects/3a57b78704cb496a908316313d556e6b/users/409a723e3fe148e0aded87cbe5f5e254/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.881320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.881616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.881904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.882628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.884278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.895297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 796/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.896357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.899688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a57b78704cb496a908316313d556e6b, user_id=409a723e3fe148e0aded87cbe5f5e254, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.902491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.910449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc78df-c53f-4cf6-89d2-1da9b8cf5194 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.920762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 797/1593] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:19 2022] PUT /identity/v3/projects/3a57b78704cb496a908316313d556e6b/users/409a723e3fe148e0aded87cbe5f5e254/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:19.920762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.978598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.979314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.979601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.979890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.980624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.982291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:19.984937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5e540-9d8e-4dcf-84eb-1e6e24eb27aa admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:19.989659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:19.990323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:19.990613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:19.990889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:19.991806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:19.993258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 797/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:19.993877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:19.995656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.004496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70076e7-c838-45b3-9a45-049c6bb2d24e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.010275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.010930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.014248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.014248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.014248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.014248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.015404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 798/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:20.016593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.025177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 798/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:20.025982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.028782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c32d-346d-4bb8-a0d0-db3ca191c99c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.033036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:20.035505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d163290-a890-4bbe-b53f-bf275eebf921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.036557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163290-a890-4bbe-b53f-bf275eebf921 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.036841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163290-a890-4bbe-b53f-bf275eebf921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.037183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163290-a890-4bbe-b53f-bf275eebf921 admin admin] PATH_INFO: `/v3/projects/d54111715ea041d0b876d1ad66a14e31/users/c468cd8df1564441935e4edfba55ccc8/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.037401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cecf6-bb27-4aa9-ae1e-2df6784f401c admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.046645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.047434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.047767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.048073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.049145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.050895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.051855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:20.055448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d163290-a890-4bbe-b53f-bf275eebf921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54111715ea041d0b876d1ad66a14e31, user_id=c468cd8df1564441935e4edfba55ccc8, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.059396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d163290-a890-4bbe-b53f-bf275eebf921 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.062432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 799/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:20.063253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.079143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 799/1598] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:20 2022] PUT /identity/v3/projects/d54111715ea041d0b876d1ad66a14e31/users/c468cd8df1564441935e4edfba55ccc8/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:20.079395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79302e84-e9d4-4c69-bb62-8bd2e7222785 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.079502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1a13-dac1-4d11-87b4-0b795fec9e81 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.079502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1a13-dac1-4d11-87b4-0b795fec9e81 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.079502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1a13-dac1-4d11-87b4-0b795fec9e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.101152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-fd6d1a13-dac1-4d11-87b4-0b795fec9e81 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.102528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fd6d1a13-dac1-4d11-87b4-0b795fec9e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.144613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.145653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.145653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.145940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.146916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.148707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.160433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 800/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:20.164251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.168672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 800/1600] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.172997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1a13-dac1-4d11-87b4-0b795fec9e81 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.179862 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce24389-d228-48be-a7ee-7feeec7d57b4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.183299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1a13-dac1-4d11-87b4-0b795fec9e81 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.185691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.186568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.186781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.187185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.188033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.188289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.189119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.189403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.189684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] PATH_INFO: `/v3/projects/1cc863c538de4d618d9740a92130634b/users/7e85418bb0364f7398f6375de042e6c5/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.189797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.200490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 801/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:20.201193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.210835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc863c538de4d618d9740a92130634b, user_id=7e85418bb0364f7398f6375de042e6c5, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.213623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.214763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477747e-8fba-4937-bbc9-6df978a7fef4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.221775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba47a8-a9e2-4088-914a-c5e33120a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.222879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba47a8-a9e2-4088-914a-c5e33120a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.223447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba47a8-a9e2-4088-914a-c5e33120a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.223564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba47a8-a9e2-4088-914a-c5e33120a7b9 admin admin] PATH_INFO: `/v3/projects/30728a67b40649f8b31ce5fd9b2d576b/users/f30ff62bca064005b198856895321f84/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.227967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 801/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:20 2022] PUT /identity/v3/projects/1cc863c538de4d618d9740a92130634b/users/7e85418bb0364f7398f6375de042e6c5/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:20.228946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.245239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba47a8-a9e2-4088-914a-c5e33120a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30728a67b40649f8b31ce5fd9b2d576b, user_id=f30ff62bca064005b198856895321f84, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.248493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba47a8-a9e2-4088-914a-c5e33120a7b9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.262909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 802/1603] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:20 2022] PUT /identity/v3/projects/30728a67b40649f8b31ce5fd9b2d576b/users/f30ff62bca064005b198856895321f84/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:20.264496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59655-d9aa-4a5f-894d-45da0d95246c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.264776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59655-d9aa-4a5f-894d-45da0d95246c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.265177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59655-d9aa-4a5f-894d-45da0d95246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.284660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-cee59655-d9aa-4a5f-894d-45da0d95246c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.286172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cee59655-d9aa-4a5f-894d-45da0d95246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.328581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb97f-4e47-45a4-a28e-80bca9756a88 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.353695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 803/1604] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.354638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee59655-d9aa-4a5f-894d-45da0d95246c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.366911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee59655-d9aa-4a5f-894d-45da0d95246c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.371704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.372910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.373198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.373514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] PATH_INFO: `/v3/projects/bd58bd3bc6a1459d88f74cd343e0827b/users/053edeb07da24a7a8678eb0ba7e0a915/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.393103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58bd3bc6a1459d88f74cd343e0827b, user_id=053edeb07da24a7a8678eb0ba7e0a915, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.397613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.415903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.416918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.417210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.417497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] PATH_INFO: `/v3/projects/98128850352a420d9ba057aeae54e991/users/cb2e8212194a4b56a6897702bd306b53/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.421306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 804/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:20 2022] PUT /identity/v3/projects/bd58bd3bc6a1459d88f74cd343e0827b/users/053edeb07da24a7a8678eb0ba7e0a915/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:20.422183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.435220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98128850352a420d9ba057aeae54e991, user_id=cb2e8212194a4b56a6897702bd306b53, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.438194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.446941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:20.454189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 802/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:20 2022] PUT /identity/v3/projects/98128850352a420d9ba057aeae54e991/users/cb2e8212194a4b56a6897702bd306b53/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:20.454987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.467927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:20.500164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c08e-86e4-4507-876f-626498934f88 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.528196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447dce-95bd-480d-a923-dff3c3e85871 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.533348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892f33-1377-45ec-a664-c14fe0843094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.534234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892f33-1377-45ec-a664-c14fe0843094 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.534518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892f33-1377-45ec-a664-c14fe0843094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.534795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892f33-1377-45ec-a664-c14fe0843094 admin admin] PATH_INFO: `/v3/projects/4267bc76763d477082ce1594ee31751b/users/4f6ea12356eb41e49182cef50be7d550/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.549053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892f33-1377-45ec-a664-c14fe0843094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4267bc76763d477082ce1594ee31751b, user_id=4f6ea12356eb41e49182cef50be7d550, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.550159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2d26-aeee-4ff8-9414-91ca9fb22170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.550801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2d26-aeee-4ff8-9414-91ca9fb22170 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.551088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2d26-aeee-4ff8-9414-91ca9fb22170 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.551396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2d26-aeee-4ff8-9414-91ca9fb22170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.551727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892f33-1377-45ec-a664-c14fe0843094 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.560999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2d26-aeee-4ff8-9414-91ca9fb22170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.562422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2d26-aeee-4ff8-9414-91ca9fb22170 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.564375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 803/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:20 2022] PUT /identity/v3/projects/4267bc76763d477082ce1594ee31751b/users/4f6ea12356eb41e49182cef50be7d550/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:20.565603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bca204-c7c0-4cae-965e-46e809a1ca55 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.565892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bca204-c7c0-4cae-965e-46e809a1ca55 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.566177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bca204-c7c0-4cae-965e-46e809a1ca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.572177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 805/1608] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:20.573622 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2339-a6b0-41cb-8986-32d429bb782d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.573983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2339-a6b0-41cb-8986-32d429bb782d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.574277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2339-a6b0-41cb-8986-32d429bb782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.602674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d2bca204-c7c0-4cae-965e-46e809a1ca55 None None] MFA Rules not processed for user `7e85418bb0364f7398f6375de042e6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.603943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d2bca204-c7c0-4cae-965e-46e809a1ca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.605265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-806d2339-a6b0-41cb-8986-32d429bb782d None None] MFA Rules not processed for user `f30ff62bca064005b198856895321f84`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.608456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-806d2339-a6b0-41cb-8986-32d429bb782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.675788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 804/1609] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.677730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bca204-c7c0-4cae-965e-46e809a1ca55 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.691654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 806/1610] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.691654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79cea-da70-4bad-9bd0-979306c38196 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.691654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79cea-da70-4bad-9bd0-979306c38196 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.691654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79cea-da70-4bad-9bd0-979306c38196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.727279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-86e79cea-da70-4bad-9bd0-979306c38196 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.728891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-86e79cea-da70-4bad-9bd0-979306c38196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.758740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bca204-c7c0-4cae-965e-46e809a1ca55 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.765685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.766762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.767104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.767550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.797256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:20.804626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 807/1611] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.804626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8c02-bc27-4083-93e8-bfaf16ae27d6 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.804626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8c02-bc27-4083-93e8-bfaf16ae27d6 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.804626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8c02-bc27-4083-93e8-bfaf16ae27d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.823906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-586a8c02-bc27-4083-93e8-bfaf16ae27d6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.825134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-586a8c02-bc27-4083-93e8-bfaf16ae27d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.835410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 808/1612] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.836516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.836809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.837095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.850026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.852703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.864396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:20.864912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 805/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:20.865787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.868228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] MFA Rules not processed for user `4f6ea12356eb41e49182cef50be7d550`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:20.873553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.876714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaead5-81d4-4208-9ef4-4e7e158f53ea service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:20.883190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb05e1c-ce57-415e-a358-764c6bfb52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:20.884141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb05e1c-ce57-415e-a358-764c6bfb52ce admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.884432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb05e1c-ce57-415e-a358-764c6bfb52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.884714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb05e1c-ce57-415e-a358-764c6bfb52ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.886098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb05e1c-ce57-415e-a358-764c6bfb52ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:20.888287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb05e1c-ce57-415e-a358-764c6bfb52ce admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:20.919357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 806/1614] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:20.920735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723629c-26d2-4b80-a9dd-e3ebb479c4a8 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:20.921535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723629c-26d2-4b80-a9dd-e3ebb479c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:20.921535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723629c-26d2-4b80-a9dd-e3ebb479c4a8 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:20.922792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 807/1615] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 23 13:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:20.923611 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723629c-26d2-4b80-a9dd-e3ebb479c4a8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.925394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-6723629c-26d2-4b80-a9dd-e3ebb479c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.974129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 809/1616] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:20.975138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:20.976535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:20.992335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8172c79-9765-40ce-894b-9f62c9cb49cf None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.019636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723629c-26d2-4b80-a9dd-e3ebb479c4a8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.029760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.030513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.030829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.031152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.109240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.109919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.110842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.111144 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.135452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.136983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.149031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 808/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:21.150379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.160907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b34ca-18d4-4b69-a3c5-56748d31e65c service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.166314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987ef43-00ec-4faa-8ac0-51fd6b3d013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.166990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987ef43-00ec-4faa-8ac0-51fd6b3d013e admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.167309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987ef43-00ec-4faa-8ac0-51fd6b3d013e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.167595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987ef43-00ec-4faa-8ac0-51fd6b3d013e admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.168288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987ef43-00ec-4faa-8ac0-51fd6b3d013e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.171752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987ef43-00ec-4faa-8ac0-51fd6b3d013e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.196581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 809/1618] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:21 2022] POST /identity/v3/users => generated 299 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:21.201648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08af6-19fd-4b97-b599-e1b80e39bbf2 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.201972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08af6-19fd-4b97-b599-e1b80e39bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.202308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08af6-19fd-4b97-b599-e1b80e39bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.227703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.228839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-23d08af6-19fd-4b97-b599-e1b80e39bbf2 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:21.229559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.230114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-23d08af6-19fd-4b97-b599-e1b80e39bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:21.245444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 810/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:21.246652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.261008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ac6d5-97d5-4ae2-ad11-482718cad5af service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.262632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:21.274029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.275728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.278147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.278457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.279613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.281643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.324127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 811/1620] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:21 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:21.325013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.335184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 810/1621] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 23 13:46:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:21.336253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d08af6-19fd-4b97-b599-e1b80e39bbf2 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.349965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d08af6-19fd-4b97-b599-e1b80e39bbf2 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.372683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:21.426788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c652590-8fed-4c5b-ad2f-d969c9007c1e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.432402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.433269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.434211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.434515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.435293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.438243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.448273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 812/1622] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:21.449113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.489764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.490565 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.491920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.492216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.494560 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.496661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.526942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 811/1623] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:21 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:21.528101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.539732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb4a97-8b7c-4bf7-88cd-befa01ffe582 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.545441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.546644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.547335 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.547864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] PATH_INFO: `/v3/projects/95af7519e4d44185be0ddeccb10656f7/users/6496af179dd647a18a27330a32129cb7/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.573537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95af7519e4d44185be0ddeccb10656f7, user_id=6496af179dd647a18a27330a32129cb7, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.573856 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d64cf-2726-466e-b103-4adf149dc12d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.577298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.580700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.582011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.582462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.582750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.597542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 812/1624] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:21 2022] PUT /identity/v3/projects/95af7519e4d44185be0ddeccb10656f7/users/6496af179dd647a18a27330a32129cb7/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:21.597542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.671908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.674883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.686747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2032-f03a-4aeb-ac4e-5b5576b237d7 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.690861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 813/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:21.692071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.692683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.693937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.694300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.694654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.695548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.697525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.705482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aaf24-938f-4cb3-80f8-e68b06fc10bf service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.709852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 813/1626] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:21.711836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.712631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.713078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.713207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.713992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.714407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.715957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.735013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 814/1627] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:21.737204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.741158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18824f21-7281-4935-a1b4-e41c4a2818fd admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.752235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c60b43-322e-4266-be32-c2e42708b551 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.756023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.757090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.757653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.758117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] PATH_INFO: `/v3/projects/f6e2c371e0a746d098de3414781ad800/users/88a37551b08d4aecabd74ce7a52217f3/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.765650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd03caf-8abb-4cd7-bb98-6549d0bd6e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.767972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd03caf-8abb-4cd7-bb98-6549d0bd6e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.769561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd03caf-8abb-4cd7-bb98-6549d0bd6e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.769861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd03caf-8abb-4cd7-bb98-6549d0bd6e3f admin admin] PATH_INFO: `/v3/projects/95af7519e4d44185be0ddeccb10656f7/users/6496af179dd647a18a27330a32129cb7/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.774276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd03caf-8abb-4cd7-bb98-6549d0bd6e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95af7519e4d44185be0ddeccb10656f7, user_id=6496af179dd647a18a27330a32129cb7, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.778817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd03caf-8abb-4cd7-bb98-6549d0bd6e3f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.791844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e2c371e0a746d098de3414781ad800, user_id=88a37551b08d4aecabd74ce7a52217f3, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.800409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.820408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 815/1628] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:21 2022] PUT /identity/v3/projects/95af7519e4d44185be0ddeccb10656f7/users/6496af179dd647a18a27330a32129cb7/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:21.822972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd394c-85f4-4e64-be1c-39946abcd19d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.823535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd394c-85f4-4e64-be1c-39946abcd19d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.823715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd394c-85f4-4e64-be1c-39946abcd19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.828994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:21.840525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 814/1629] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:21 2022] PUT /identity/v3/projects/f6e2c371e0a746d098de3414781ad800/users/88a37551b08d4aecabd74ce7a52217f3/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:21.843419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.895194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-7dfd394c-85f4-4e64-be1c-39946abcd19d None None] MFA Rules not processed for user `6496af179dd647a18a27330a32129cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:21.898271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7dfd394c-85f4-4e64-be1c-39946abcd19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:21.920673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a99c5b-7dfa-42c5-903f-843dfcde3586 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.926881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5ccc2-df7e-4a9c-ad56-c5d5615d4607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:21.928035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ccc2-df7e-4a9c-ad56-c5d5615d4607 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.928329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ccc2-df7e-4a9c-ad56-c5d5615d4607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.928613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ccc2-df7e-4a9c-ad56-c5d5615d4607 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.929858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5ccc2-df7e-4a9c-ad56-c5d5615d4607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:21.932134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5ccc2-df7e-4a9c-ad56-c5d5615d4607 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:21.953285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 815/1630] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:21.960067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbc49a-c9ef-4f42-8c77-54176eb8dcba None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:21.960503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbc49a-c9ef-4f42-8c77-54176eb8dcba None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:21.960797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbc49a-c9ef-4f42-8c77-54176eb8dcba None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:21.963380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 816/1631] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 23 13:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:21.964140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbc49a-c9ef-4f42-8c77-54176eb8dcba None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:21.989679 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbc49a-c9ef-4f42-8c77-54176eb8dcba None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:21.993128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:22.003311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae2fe2-2a57-4733-9d32-9c2b5e0bf419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:22.004511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae2fe2-2a57-4733-9d32-9c2b5e0bf419 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.005103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae2fe2-2a57-4733-9d32-9c2b5e0bf419 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.005536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae2fe2-2a57-4733-9d32-9c2b5e0bf419 admin admin] PATH_INFO: `/v3/projects/f6e2c371e0a746d098de3414781ad800/users/88a37551b08d4aecabd74ce7a52217f3/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.008195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae2fe2-2a57-4733-9d32-9c2b5e0bf419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e2c371e0a746d098de3414781ad800, user_id=88a37551b08d4aecabd74ce7a52217f3, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:22.013247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae2fe2-2a57-4733-9d32-9c2b5e0bf419 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:22.048116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 817/1632] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:21 2022] PUT /identity/v3/projects/f6e2c371e0a746d098de3414781ad800/users/88a37551b08d4aecabd74ce7a52217f3/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:22.050034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902fcf2-f866-47a7-a808-96229f2d6cc6 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.050353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902fcf2-f866-47a7-a808-96229f2d6cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.050672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902fcf2-f866-47a7-a808-96229f2d6cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.077108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 816/1633] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:22.078884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3cc05-fe6b-4a77-952f-95df068f33bb None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.079537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3cc05-fe6b-4a77-952f-95df068f33bb None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.079715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c902fcf2-f866-47a7-a808-96229f2d6cc6 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:22.080201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3cc05-fe6b-4a77-952f-95df068f33bb None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.082389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 817/1634] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 23 13:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:22.085016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d20e4-8610-4377-91fd-8c7109699b8e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.086149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d20e4-8610-4377-91fd-8c7109699b8e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.086647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d20e4-8610-4377-91fd-8c7109699b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.086880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c902fcf2-f866-47a7-a808-96229f2d6cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:22.135926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-025d20e4-8610-4377-91fd-8c7109699b8e None None] MFA Rules not processed for user `88a37551b08d4aecabd74ce7a52217f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:22.137722 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-025d20e4-8610-4377-91fd-8c7109699b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:22.239607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 818/1635] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:22.241358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539081-9e38-4625-90c0-7ced82dffa52 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.242294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539081-9e38-4625-90c0-7ced82dffa52 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.242294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539081-9e38-4625-90c0-7ced82dffa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.265056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-89539081-9e38-4625-90c0-7ced82dffa52 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:22.267083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-89539081-9e38-4625-90c0-7ced82dffa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:22.270843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 818/1636] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 23 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:22.272098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902fcf2-f866-47a7-a808-96229f2d6cc6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:22.294943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 819/1637] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:22.297768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89539081-9e38-4625-90c0-7ced82dffa52 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:22.409737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902fcf2-f866-47a7-a808-96229f2d6cc6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:22.415106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:22.416760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.417090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.417374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.444765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89539081-9e38-4625-90c0-7ced82dffa52 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:22.455230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f06faf-9b7e-4263-a118-78360e1f21f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:22.455715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f06faf-9b7e-4263-a118-78360e1f21f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.456007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f06faf-9b7e-4263-a118-78360e1f21f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.456291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f06faf-9b7e-4263-a118-78360e1f21f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.463988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:22.476642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f06faf-9b7e-4263-a118-78360e1f21f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:22.478288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f06faf-9b7e-4263-a118-78360e1f21f7 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:22.514462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:22.516639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:22.527243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 820/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:22.531919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd93c9-29f0-4580-8d4c-8db2782feeee None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.532658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd93c9-29f0-4580-8d4c-8db2782feeee None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.532658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd93c9-29f0-4580-8d4c-8db2782feeee None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.533927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 821/1639] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 23 13:46:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:22.540123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e011-6d64-4681-bb64-a50a57b63a97 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.540421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e011-6d64-4681-bb64-a50a57b63a97 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.540711 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e011-6d64-4681-bb64-a50a57b63a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.545426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 819/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:22.573855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:22.579157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-bcf8e011-6d64-4681-bb64-a50a57b63a97 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:22.580720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bcf8e011-6d64-4681-bb64-a50a57b63a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:22.599683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 822/1641] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:22.600590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8e011-6d64-4681-bb64-a50a57b63a97 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:22.623892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8e011-6d64-4681-bb64-a50a57b63a97 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:22.636560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:22.637229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.637520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.638012 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.667984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:22.670188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:22.674857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b319c-acae-4b87-b225-e3ce2f1a10e3 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:22.681431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:22.682551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.683032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.683940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] PATH_INFO: `/v3/users/7e85418bb0364f7398f6375de042e6c5` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.685477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e85418bb0364f7398f6375de042e6c5)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:22.687437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: WARNING py.warnings [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:46:22.687437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: warnings.warn(msg) Jun 23 13:46:22.687437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: Jun 23 13:46:22.689059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:22.704683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 823/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:22.707674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:22.737186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2eb59-3f2e-4c1a-a585-df7f6e5140f1 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:22.748495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c879b42-61fb-4d2f-9f3d-c227fb21f375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:22.749160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c879b42-61fb-4d2f-9f3d-c227fb21f375 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.749449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c879b42-61fb-4d2f-9f3d-c227fb21f375 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.749731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c879b42-61fb-4d2f-9f3d-c227fb21f375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:22.788732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c879b42-61fb-4d2f-9f3d-c227fb21f375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:22.790248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c879b42-61fb-4d2f-9f3d-c227fb21f375 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:22.804591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 824/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:22.840468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e85418bb0364f7398f6375de042e6c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:22.913014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e85418bb0364f7398f6375de042e6c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:22.925380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e85418bb0364f7398f6375de042e6c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:22.946621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e85418bb0364f7398f6375de042e6c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:22.947930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e85418bb0364f7398f6375de042e6c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:22.966430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 820/1644] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:22 2022] DELETE /identity/v3/users/7e85418bb0364f7398f6375de042e6c5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:22.973032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:22.973405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:22.973692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:23.017373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:23.019836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:23.044417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:23.187152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 825/1645] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:23.235243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:23.237908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:23.382296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:23.420163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6721-1320-4718-8d79-5b891a19bba8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:23.428709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1997a9-c663-4cc8-b037-34d3ad80a57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:23.429476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1997a9-c663-4cc8-b037-34d3ad80a57b service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:23.429713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1997a9-c663-4cc8-b037-34d3ad80a57b service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:23.430002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1997a9-c663-4cc8-b037-34d3ad80a57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:23.452750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1997a9-c663-4cc8-b037-34d3ad80a57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:23.454224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1997a9-c663-4cc8-b037-34d3ad80a57b service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:23.484346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 821/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:23.980589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:23.982265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:24.001122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be4791-b3c4-4377-8da6-5a258caaca89 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:24.010730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:24.014282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:24.014526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:24.014810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] PATH_INFO: `/v3/users/4f6ea12356eb41e49182cef50be7d550` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:24.016201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6ea12356eb41e49182cef50be7d550)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:24.018316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:24.109697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6ea12356eb41e49182cef50be7d550'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.144553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6ea12356eb41e49182cef50be7d550'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.146973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6ea12356eb41e49182cef50be7d550'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.158916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6ea12356eb41e49182cef50be7d550'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.178892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6ea12356eb41e49182cef50be7d550'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.197276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 826/1647] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:23 2022] DELETE /identity/v3/users/4f6ea12356eb41e49182cef50be7d550 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:24.198125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:24.198427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:24.198714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:24.221645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:24.222851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:24.319077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 822/1648] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:24.348460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:24.350040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:24.460018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def44c7d-9de1-4926-804a-407f3e0c63d8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:24.471197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:24.471905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:24.472404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:24.472611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:24.491831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:24.493241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:24.513694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 827/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:24.521106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:24.523274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:24.550564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8517-b541-4f1b-8bd5-00799606c699 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:24.565167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:24.566511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:24.567047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:24.567961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] PATH_INFO: `/v3/projects/1cc863c538de4d618d9740a92130634b` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:24.570179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc863c538de4d618d9740a92130634b)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:24.576515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:24.687982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc863c538de4d618d9740a92130634b', 'request_id': 'req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.705837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc863c538de4d618d9740a92130634b', 'request_id': 'req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.719123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc863c538de4d618d9740a92130634b', 'request_id': 'req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.741294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] The token cache is being invalidate because project 1cc863c538de4d618d9740a92130634b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:24.743130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.744916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:24.753299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 823/1650] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:24 2022] DELETE /identity/v3/projects/1cc863c538de4d618d9740a92130634b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:24.753859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:24.766356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd9e4b-7d5c-457e-87ca-2e994c79ff72 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:24.828789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:24.915089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:24.916116 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:24.916410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:24.916695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] PATH_INFO: `/v3/users/6496af179dd647a18a27330a32129cb7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:24.918758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6496af179dd647a18a27330a32129cb7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:24.920906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:25.044847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6496af179dd647a18a27330a32129cb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:25.084550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6496af179dd647a18a27330a32129cb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:25.087618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6496af179dd647a18a27330a32129cb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:25.136064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6496af179dd647a18a27330a32129cb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:25.149705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6496af179dd647a18a27330a32129cb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:25.162576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 828/1651] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:24 2022] DELETE /identity/v3/users/6496af179dd647a18a27330a32129cb7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:25.895349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:25.897647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:25.924592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d1d2-63b6-4eb9-ba2a-a95bf1f24369 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:26.096397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:26.098108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:26.098533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:26.099545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] PATH_INFO: `/v3/projects/95af7519e4d44185be0ddeccb10656f7` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:26.101520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95af7519e4d44185be0ddeccb10656f7)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:26.105300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:26.130309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:26.205334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:26.207683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:26.270208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95af7519e4d44185be0ddeccb10656f7', 'request_id': 'req-aab3a3bf-d67a-435a-b5da-1e365efbc173'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.272213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0978-fb88-448a-93ba-f3d30237b40c admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:26.289356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95af7519e4d44185be0ddeccb10656f7', 'request_id': 'req-aab3a3bf-d67a-435a-b5da-1e365efbc173'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.304038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95af7519e4d44185be0ddeccb10656f7', 'request_id': 'req-aab3a3bf-d67a-435a-b5da-1e365efbc173'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.340036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] The token cache is being invalidate because project 95af7519e4d44185be0ddeccb10656f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:26.340337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.341020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-aab3a3bf-d67a-435a-b5da-1e365efbc173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.348027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 824/1652] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:25 2022] DELETE /identity/v3/projects/95af7519e4d44185be0ddeccb10656f7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:26.349903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9b46-2f0a-4e07-a2f0-3b85d2096eb8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:26.350543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9b46-2f0a-4e07-a2f0-3b85d2096eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:26.350979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9b46-2f0a-4e07-a2f0-3b85d2096eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:26.412076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-443a9b46-2f0a-4e07-a2f0-3b85d2096eb8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:26.414593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-443a9b46-2f0a-4e07-a2f0-3b85d2096eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:26.460251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:26.461154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:26.461447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:26.461736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] PATH_INFO: `/v3/projects/4267bc76763d477082ce1594ee31751b` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:26.483938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4267bc76763d477082ce1594ee31751b)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:26.486937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: WARNING py.warnings [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:46:26.486937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: warnings.warn(msg) Jun 23 13:46:26.486937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: Jun 23 13:46:26.492762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:26.617682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 825/1653] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:26.620067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90d5ff-feba-4418-be45-a9fe84b83838 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:26.620561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90d5ff-feba-4418-be45-a9fe84b83838 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:26.620988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90d5ff-feba-4418-be45-a9fe84b83838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:26.658492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-ea90d5ff-feba-4418-be45-a9fe84b83838 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:26.660329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ea90d5ff-feba-4418-be45-a9fe84b83838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:26.690755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4267bc76763d477082ce1594ee31751b', 'request_id': 'req-b1106df0-03d4-4c60-971f-907a2d4af005'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.692694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:26.702180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4267bc76763d477082ce1594ee31751b', 'request_id': 'req-b1106df0-03d4-4c60-971f-907a2d4af005'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.712713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4267bc76763d477082ce1594ee31751b', 'request_id': 'req-b1106df0-03d4-4c60-971f-907a2d4af005'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.737345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] The token cache is being invalidate because project 4267bc76763d477082ce1594ee31751b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:26.737645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.738381 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:26.743149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 829/1654] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:26 2022] DELETE /identity/v3/projects/4267bc76763d477082ce1594ee31751b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:26.744064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:26.745712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:26.827013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 826/1655] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:26.832459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90d5ff-feba-4418-be45-a9fe84b83838 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:26.868001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90d5ff-feba-4418-be45-a9fe84b83838 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:26.870555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1106df0-03d4-4c60-971f-907a2d4af005 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:26.876922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:26.877835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:26.878127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:26.878411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] PATH_INFO: `/v3/users/88a37551b08d4aecabd74ce7a52217f3` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:26.882890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a37551b08d4aecabd74ce7a52217f3)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:26.887910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:26.891002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:26.891730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:26.892304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:26.892739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:26.893550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:26.893868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:26.895579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:26.932921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 827/1656] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:26.938964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:26.976571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26746723-038b-41ca-bf18-149c67cb8665 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:27.007819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:27.008570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:27.008862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:27.009204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:27.009920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:27.015230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:27.034122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a37551b08d4aecabd74ce7a52217f3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.111734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a37551b08d4aecabd74ce7a52217f3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.117541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a37551b08d4aecabd74ce7a52217f3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.154485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a37551b08d4aecabd74ce7a52217f3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.156475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 828/1657] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:26 2022] POST /identity/v3/projects => generated 399 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:27.167795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:27.173905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:27.183601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a37551b08d4aecabd74ce7a52217f3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:27.201023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:27.214752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 830/1658] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:26 2022] DELETE /identity/v3/users/88a37551b08d4aecabd74ce7a52217f3 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:27.442658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ccc3-770a-44c5-a418-094d10942437 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:27.662266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:27.666686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:27.667112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:27.667436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:27.668190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:27.675964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:27.721289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 829/1659] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:27 2022] POST /identity/v3/users => generated 300 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:27.725790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:27.749635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142e9e-c60f-4c69-95a4-98e2a4d8a022 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:27.769548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:27.770913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:27.771491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:27.772246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:27.773218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:27.776274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:27.814090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 831/1660] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:27.814658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:27.831804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e71db-f785-42a6-a040-765073f243d4 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:27.846020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974178b-a2ca-4934-890d-0906e274205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:27.847520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974178b-a2ca-4934-890d-0906e274205b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:27.848017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974178b-a2ca-4934-890d-0906e274205b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:27.849441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974178b-a2ca-4934-890d-0906e274205b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:27.854419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974178b-a2ca-4934-890d-0906e274205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:27.858326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974178b-a2ca-4934-890d-0906e274205b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:27.904802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:27.920494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 830/1661] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:27.936127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ad98-06e1-4e45-8022-5977b0edee23 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:27.952209 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:27.953634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:27.954002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:27.954364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] PATH_INFO: `/v3/projects/0f6889990ca7483291fd1a975faa3672/users/9c70085c476f4aa2880eb6e678432293/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.004411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6889990ca7483291fd1a975faa3672, user_id=9c70085c476f4aa2880eb6e678432293, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.007375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.039319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 832/1662] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:27 2022] PUT /identity/v3/projects/0f6889990ca7483291fd1a975faa3672/users/9c70085c476f4aa2880eb6e678432293/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:28.049397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e583-30d4-4417-a184-febf5a33d3c4 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.049707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e583-30d4-4417-a184-febf5a33d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.049981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e583-30d4-4417-a184-febf5a33d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.121914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9452e583-30d4-4417-a184-febf5a33d3c4 None None] MFA Rules not processed for user `9c70085c476f4aa2880eb6e678432293`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:28.124607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9452e583-30d4-4417-a184-febf5a33d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:28.326506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 831/1663] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:28.330932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.422494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:28.593148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34949ff4-5cf9-45a7-a6f1-7786ceb34197 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.616011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.617555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.619328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.620923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.624461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.632117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.780716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 833/1664] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/projects => generated 399 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:28.781974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e583-30d4-4417-a184-febf5a33d3c4 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.800461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e583-30d4-4417-a184-febf5a33d3c4 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:28.875144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:28.910731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:28.914325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:28.955400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:28.957337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:28.957635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:28.957923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:28.958814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:28.960998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:28.995290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 832/1665] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:28 2022] POST /identity/v3/users => generated 306 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:28.996399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.000107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.021499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb168-d9a1-4c46-af7e-c73c274f4fe1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.034930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.036749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.037268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.037682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] PATH_INFO: `/v3/users/f30ff62bca064005b198856895321f84` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.039492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30ff62bca064005b198856895321f84)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.043862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.105249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2accf-7d37-4bdb-a851-42ff4633a2b2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.125408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30ff62bca064005b198856895321f84'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.125773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.126669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.126963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.127267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] PATH_INFO: `/v3/projects/f6e2c371e0a746d098de3414781ad800` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.128552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e2c371e0a746d098de3414781ad800)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.130551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.148249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30ff62bca064005b198856895321f84'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.157375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30ff62bca064005b198856895321f84'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.166474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30ff62bca064005b198856895321f84'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.168274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30ff62bca064005b198856895321f84'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.175942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 833/1666] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:28 2022] DELETE /identity/v3/users/f30ff62bca064005b198856895321f84 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:29.177696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.179282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.235162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e2c371e0a746d098de3414781ad800', 'request_id': 'req-180aadd4-5d7a-4792-af40-377b839e9be7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.252929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e2c371e0a746d098de3414781ad800', 'request_id': 'req-180aadd4-5d7a-4792-af40-377b839e9be7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.268196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e2c371e0a746d098de3414781ad800', 'request_id': 'req-180aadd4-5d7a-4792-af40-377b839e9be7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.305827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] The token cache is being invalidate because project f6e2c371e0a746d098de3414781ad800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:29.306126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.310964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-180aadd4-5d7a-4792-af40-377b839e9be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:29.322491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 834/1667] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:28 2022] DELETE /identity/v3/projects/f6e2c371e0a746d098de3414781ad800 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:29.327456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d386a-c53a-454d-8916-33e48e1e302f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.328548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d386a-c53a-454d-8916-33e48e1e302f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.329179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d386a-c53a-454d-8916-33e48e1e302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.365424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-178d386a-c53a-454d-8916-33e48e1e302f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:29.367539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-178d386a-c53a-454d-8916-33e48e1e302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.368538 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cba9a9-5433-49e4-b315-ba6c4be7dbd5 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.438142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:29.453673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:29.533706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.534017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.534312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.534599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.535382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.536208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 835/1668] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:29.537045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.539999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.547739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.548291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.558501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 834/1669] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:29.560073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.567606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.590976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:29.592563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.597246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763595-6b79-474d-a8ab-8d7a841e27bf admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.608429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517304e-49c3-4508-9805-1e87544ce97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.609360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517304e-49c3-4508-9805-1e87544ce97a admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.609655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517304e-49c3-4508-9805-1e87544ce97a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.609939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517304e-49c3-4508-9805-1e87544ce97a admin admin] PATH_INFO: `/v3/projects/e84e3720bdd54a939b599e89ce0f79d3/users/a0a25c14c72a40eb8fe8db7fad5dbcee/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.612621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 836/1670] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:29.615033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.623408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.665703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517304e-49c3-4508-9805-1e87544ce97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84e3720bdd54a939b599e89ce0f79d3, user_id=a0a25c14c72a40eb8fe8db7fad5dbcee, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.670477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517304e-49c3-4508-9805-1e87544ce97a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.706875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 835/1671] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:29 2022] PUT /identity/v3/projects/e84e3720bdd54a939b599e89ce0f79d3/users/a0a25c14c72a40eb8fe8db7fad5dbcee/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:29.708303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4200f8-207a-4da9-bc84-652209384f27 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.708597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4200f8-207a-4da9-bc84-652209384f27 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.708877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4200f8-207a-4da9-bc84-652209384f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.760754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3e4200f8-207a-4da9-bc84-652209384f27 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:29.762023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3e4200f8-207a-4da9-bc84-652209384f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:29.796494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ef4d-87c8-42e3-bea5-77fc0bec626a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.936102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 836/1672] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:29.937550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.938231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.938393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4200f8-207a-4da9-bc84-652209384f27 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:29.939189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.939496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.953675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4200f8-207a-4da9-bc84-652209384f27 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:29.963154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.966219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.971199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:29.972424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:29.972751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:29.974237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:29.975017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:29.978912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:29.989067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 837/1673] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:29.991092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.003551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 837/1674] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:30.006541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.010830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605f1d-891c-440b-80dd-7d195c3747f8 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.025173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.026749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.027072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.027386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.029075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:30.029391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a8388-21c9-4e5f-b8a5-3e71a76f3947 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.029977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.033936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.038940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f767b5a-b2e5-42fd-b42d-423af0b293a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.041831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f767b5a-b2e5-42fd-b42d-423af0b293a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.042190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f767b5a-b2e5-42fd-b42d-423af0b293a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.043031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f767b5a-b2e5-42fd-b42d-423af0b293a6 admin admin] PATH_INFO: `/v3/projects/e84e3720bdd54a939b599e89ce0f79d3/users/a0a25c14c72a40eb8fe8db7fad5dbcee/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.048293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f767b5a-b2e5-42fd-b42d-423af0b293a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84e3720bdd54a939b599e89ce0f79d3, user_id=a0a25c14c72a40eb8fe8db7fad5dbcee, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.054717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f767b5a-b2e5-42fd-b42d-423af0b293a6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.063079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 838/1675] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:30.064738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.084520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 838/1676] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:30 2022] PUT /identity/v3/projects/e84e3720bdd54a939b599e89ce0f79d3/users/a0a25c14c72a40eb8fe8db7fad5dbcee/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:30.085734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77fa5-d705-4c02-97cd-621f9021bef3 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.097106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.098213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.098564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.178376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] MFA Rules not processed for user `a0a25c14c72a40eb8fe8db7fad5dbcee`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:30.182737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:30.250349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.252353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.252645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.254073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.255853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.263734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.324814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 839/1677] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:30 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:30.330672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.339538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:30.379495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 839/1678] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:30.389038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.390472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:30.401408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:30.487869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed25a8-714f-4387-ba36-2dc444783e12 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.495855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.497374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.498388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.498854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.500406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.503657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.533356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 840/1679] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:30 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:30.538093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.550330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bd95c-7966-4f88-8089-0d1b9936e185 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.556358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf507286-27c6-4fff-9e70-ba31f83b87e9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.566995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.569293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.569991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.571013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.572720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.575490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.592962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 841/1680] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:30.596501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.611456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba556-8d74-410d-80d2-4a1a3ef7c482 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.619341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.621463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.622443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.623478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.624519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.627815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.650363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 842/1681] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:46:30.654289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.672359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366b3e-5abf-4f3f-aa92-db74d2e78215 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:30.680449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.681219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.681509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.681789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.684928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba071e-60b5-4e04-98ac-65844ac1d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:30.686585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba071e-60b5-4e04-98ac-65844ac1d3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.687145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba071e-60b5-4e04-98ac-65844ac1d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.687525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba071e-60b5-4e04-98ac-65844ac1d3b8 admin admin] PATH_INFO: `/v3/projects/48401fcf6c1a4ba2b45e12dfe8110e9b/users/1e358695816b4f1aa1da4b3a0b151b61/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.729598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba071e-60b5-4e04-98ac-65844ac1d3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48401fcf6c1a4ba2b45e12dfe8110e9b, user_id=1e358695816b4f1aa1da4b3a0b151b61, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.738362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba071e-60b5-4e04-98ac-65844ac1d3b8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.764512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:30.766201 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:30.783410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 843/1682] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:30 2022] PUT /identity/v3/projects/48401fcf6c1a4ba2b45e12dfe8110e9b/users/1e358695816b4f1aa1da4b3a0b151b61/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:30.785843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff66e-d2df-4364-b9dd-77e0f9665106 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:30.786141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff66e-d2df-4364-b9dd-77e0f9665106 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:30.786427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff66e-d2df-4364-b9dd-77e0f9665106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:30.792381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 840/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:30.852082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b6dff66e-d2df-4364-b9dd-77e0f9665106 None None] MFA Rules not processed for user `1e358695816b4f1aa1da4b3a0b151b61`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:30.856204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b6dff66e-d2df-4364-b9dd-77e0f9665106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:30.909900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:30.924776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce490-fcaf-4363-b5b3-b5f20dfb9662 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:31.068200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 844/1684] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:31.069985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff66e-d2df-4364-b9dd-77e0f9665106 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:31.080899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:31.083863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:31.083863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:31.084584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:31.090697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:31.163989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:31.186942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:31.264361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff66e-d2df-4364-b9dd-77e0f9665106 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:31.275660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:31.278261 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:31.279992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:31.280296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:31.281035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:31.282985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:31.312576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:31.316471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:31.339006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 841/1685] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:31.357509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:31.363103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 845/1686] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:31 2022] POST /identity/v3/projects => generated 387 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:31.385527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a909fa-c901-41c6-ac55-cd9d78d22ebf service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:31.538995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:31.539732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:31.540017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:31.540295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:31.541408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:31.544503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:31.581241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 842/1687] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:31 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:31.585020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:31.602784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806140-c2aa-4798-adbf-8fa99f930aa2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:31.622345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:31.623726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:31.624890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:31.627069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:31.630239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:31.645116 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:31.672360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 846/1688] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:31.673424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:31.689112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e2e80-fd20-494a-aca7-67c4d1497c44 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:31.704299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:31.706402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:31.708911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:31.710337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] PATH_INFO: `/v3/projects/9f7d4a180a644aadaed3f9f2b7058982/users/e2b6f31c733c4b91af475205f9a646b3/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:31.776062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7d4a180a644aadaed3f9f2b7058982, user_id=e2b6f31c733c4b91af475205f9a646b3, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:31.790667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:31.828096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 843/1689] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:31 2022] PUT /identity/v3/projects/9f7d4a180a644aadaed3f9f2b7058982/users/e2b6f31c733c4b91af475205f9a646b3/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:31.830411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:31.852080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3b2b-960a-4a65-acbc-abde029e8f32 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:32.041257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cda595-a739-4a9d-aee9-163d8c4aa3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:32.050849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda595-a739-4a9d-aee9-163d8c4aa3ee admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:32.050849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda595-a739-4a9d-aee9-163d8c4aa3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:32.050849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda595-a739-4a9d-aee9-163d8c4aa3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:32.050849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cda595-a739-4a9d-aee9-163d8c4aa3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:32.050849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cda595-a739-4a9d-aee9-163d8c4aa3ee admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:32.080318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 847/1690] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:32.085213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:32.104802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2432-5ec4-4ee5-85fa-a5f5f6ac6f9a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:32.117591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:32.118445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:32.118724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:32.119006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] PATH_INFO: `/v3/projects/9f7d4a180a644aadaed3f9f2b7058982/users/e2b6f31c733c4b91af475205f9a646b3/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:32.124743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7d4a180a644aadaed3f9f2b7058982, user_id=e2b6f31c733c4b91af475205f9a646b3, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:32.127618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:32.160471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 844/1691] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:32 2022] PUT /identity/v3/projects/9f7d4a180a644aadaed3f9f2b7058982/users/e2b6f31c733c4b91af475205f9a646b3/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:32.172223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:32.172424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:32.172700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:32.271574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] MFA Rules not processed for user `e2b6f31c733c4b91af475205f9a646b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:32.280877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:32.283691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:32.293292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:32.558903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f99e8-250e-4e17-99c8-46c0a2414b28 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:32.565531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:32.566891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:32.566891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:32.567137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] PATH_INFO: `/v3/projects/30728a67b40649f8b31ce5fd9b2d576b` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:32.569333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30728a67b40649f8b31ce5fd9b2d576b)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:32.571344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:32.620957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:32.623896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 848/1692] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:32.626590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:32.640981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:32.670819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5d0fc-89a7-4de2-8eca-7dea154e41c8 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:32.679060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30728a67b40649f8b31ce5fd9b2d576b', 'request_id': 'req-77525e0d-c76b-41f2-8b77-ac3592811e75'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:32.693571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30728a67b40649f8b31ce5fd9b2d576b', 'request_id': 'req-77525e0d-c76b-41f2-8b77-ac3592811e75'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:32.705877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30728a67b40649f8b31ce5fd9b2d576b', 'request_id': 'req-77525e0d-c76b-41f2-8b77-ac3592811e75'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:32.727257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] The token cache is being invalidate because project 30728a67b40649f8b31ce5fd9b2d576b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:32.727587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:32.729386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:32.739139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 845/1693] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:32 2022] DELETE /identity/v3/projects/30728a67b40649f8b31ce5fd9b2d576b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:32.739139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:32.740805 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:32.758450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:32.824477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:32.825022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:32.825311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:32.825592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] PATH_INFO: `/v3/users/6777b374897144e599885011d7df3381` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:32.829836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6777b374897144e599885011d7df3381)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:32.832503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:32.913873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525e0d-c76b-41f2-8b77-ac3592811e75 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:32.922755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438300-b790-4c45-bc43-c1c127a85010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:32.923653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438300-b790-4c45-bc43-c1c127a85010 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:32.924085 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438300-b790-4c45-bc43-c1c127a85010 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:32.924521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438300-b790-4c45-bc43-c1c127a85010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:32.928660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ba438300-b790-4c45-bc43-c1c127a85010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:32.941165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6777b374897144e599885011d7df3381'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:32.984014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6777b374897144e599885011d7df3381'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:32.984846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6777b374897144e599885011d7df3381'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.000080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6777b374897144e599885011d7df3381'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.014873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-30705278-dbd9-4008-a624-a84725f295aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6777b374897144e599885011d7df3381'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.031686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 849/1694] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:32 2022] DELETE /identity/v3/users/6777b374897144e599885011d7df3381 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:33.033404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.035005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.039247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.079783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:33.085233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.099850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438300-b790-4c45-bc43-c1c127a85010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:33.105927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438300-b790-4c45-bc43-c1c127a85010 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:33.134729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 846/1695] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:33.137140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526abe-beb4-4649-8951-b6db21a4d4e2 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.140186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526abe-beb4-4649-8951-b6db21a4d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.140635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526abe-beb4-4649-8951-b6db21a4d4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.187545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e1526abe-beb4-4649-8951-b6db21a4d4e2 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:33.194460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e1526abe-beb4-4649-8951-b6db21a4d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.287875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 850/1696] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:33.287875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:33.288758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.316436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e915910-1816-4af6-a606-4d25fc02f865 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:33.331036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:33.332154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.332271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.332503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] PATH_INFO: `/v3/users/1e358695816b4f1aa1da4b3a0b151b61` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.336181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:33.336347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e358695816b4f1aa1da4b3a0b151b61)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:33.342570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:33.362250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 847/1697] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:33.363637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.367048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.367417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.411701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:33.421458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.449333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 848/1698] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:33.450588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:33.452460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.460384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:33.464572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e358695816b4f1aa1da4b3a0b151b61'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.502414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e358695816b4f1aa1da4b3a0b151b61'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.503589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e358695816b4f1aa1da4b3a0b151b61'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.516918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e358695816b4f1aa1da4b3a0b151b61'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.536017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e358695816b4f1aa1da4b3a0b151b61'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:33.555295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 851/1699] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:33 2022] DELETE /identity/v3/users/1e358695816b4f1aa1da4b3a0b151b61 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:33.562587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:33.566656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.621486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff79d-c98f-456c-b3cd-0dd88626745c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:33.762052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:33.762836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.763139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.764005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.766879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.818254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf3c9-8c4d-4075-b925-d549f47c50bd admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:33.834748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018fdac-f3c7-48d9-8351-0519e5cd854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:33.835824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018fdac-f3c7-48d9-8351-0519e5cd854b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.836291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018fdac-f3c7-48d9-8351-0519e5cd854b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.836580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018fdac-f3c7-48d9-8351-0519e5cd854b admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.837327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018fdac-f3c7-48d9-8351-0519e5cd854b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:33.837637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018fdac-f3c7-48d9-8351-0519e5cd854b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:33.839280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018fdac-f3c7-48d9-8351-0519e5cd854b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:33.872721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 852/1700] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:33.872721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab23b4-a8bb-4d7e-b7d5-b896ba693de4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.872721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab23b4-a8bb-4d7e-b7d5-b896ba693de4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.872721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab23b4-a8bb-4d7e-b7d5-b896ba693de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.905572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-c3ab23b4-a8bb-4d7e-b7d5-b896ba693de4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:33.910181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c3ab23b4-a8bb-4d7e-b7d5-b896ba693de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:33.928083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 853/1701] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:33.929149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab23b4-a8bb-4d7e-b7d5-b896ba693de4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:33.942852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab23b4-a8bb-4d7e-b7d5-b896ba693de4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:33.951505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:33.952668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:33.952953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:33.953228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:33.954076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:33.957681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.015757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 854/1702] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:33 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:34.017308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:34.019928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:34.020797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:34.024539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.060184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 849/1703] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:34.061301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:34.082829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e0680-1c8c-4872-a3e1-cb7e9a465e23 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:34.114690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bed7a-8b44-495a-a52b-d28b53b4cc15 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:34.119435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:34.121288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:34.121727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:34.122235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:34.183556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:34.209197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:34.220207 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:34.221144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:34.221694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:34.223139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:34.224384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:34.226925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.231585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:34.238211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.265413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 855/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:34.272565 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 850/1705] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:34 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:34.273198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:34.285699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42831dae-f029-4ffb-a828-49a7b2418871 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:34.299982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:34.300902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:34.301023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:34.301286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:34.302412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:34.304587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.323409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 856/1706] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:34.329334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:34.344451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353ecf7-aba6-4bca-bd6b-b79e17ca25cd admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:34.351243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c007-494a-491d-b495-430c844c2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:34.352108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c007-494a-491d-b495-430c844c2789 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:34.352396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c007-494a-491d-b495-430c844c2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:34.352760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c007-494a-491d-b495-430c844c2789 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:34.353516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860c007-494a-491d-b495-430c844c2789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:34.356676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860c007-494a-491d-b495-430c844c2789 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.375528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 851/1707] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:34.377045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:34.393444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007816-3ff4-4076-87ec-c7a361dad913 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:34.400006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:34.401889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:34.402646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:34.403693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] PATH_INFO: `/v3/projects/875e16dcb2f9447e8ddc2b93177fd3d7/users/26e5e87816974cb290dcd54f3a932155/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:34.434609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875e16dcb2f9447e8ddc2b93177fd3d7, user_id=26e5e87816974cb290dcd54f3a932155, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:34.439551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.469388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 857/1708] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:34 2022] PUT /identity/v3/projects/875e16dcb2f9447e8ddc2b93177fd3d7/users/26e5e87816974cb290dcd54f3a932155/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:34.480533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdade14-2944-4d53-949f-8c8c6bb750cc None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:34.485389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdade14-2944-4d53-949f-8c8c6bb750cc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:34.485389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdade14-2944-4d53-949f-8c8c6bb750cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:34.531568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-efdade14-2944-4d53-949f-8c8c6bb750cc None None] MFA Rules not processed for user `26e5e87816974cb290dcd54f3a932155`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:34.547511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-efdade14-2944-4d53-949f-8c8c6bb750cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:34.711314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 852/1709] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:34.720254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:34.722395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:34.840366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12796ce7-69bc-4590-8d79-bcc3898f79a4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:34.854096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb44601-d95e-48f9-a414-1ad8658b15b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:34.857940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb44601-d95e-48f9-a414-1ad8658b15b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:34.858470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb44601-d95e-48f9-a414-1ad8658b15b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:34.860387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb44601-d95e-48f9-a414-1ad8658b15b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:34.874054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb44601-d95e-48f9-a414-1ad8658b15b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:34.877013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb44601-d95e-48f9-a414-1ad8658b15b9 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:34.901499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 858/1710] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:34.926986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdade14-2944-4d53-949f-8c8c6bb750cc None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:35.036379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdade14-2944-4d53-949f-8c8c6bb750cc None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:35.043651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:35.045136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:35.045424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:35.045748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] PATH_INFO: `/v3/users/26e5e87816974cb290dcd54f3a932155` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:35.048668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e5e87816974cb290dcd54f3a932155)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:35.080247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:35.226061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e5e87816974cb290dcd54f3a932155'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:35.256562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e5e87816974cb290dcd54f3a932155'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:35.262830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:35.268378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e5e87816974cb290dcd54f3a932155'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:35.287417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e5e87816974cb290dcd54f3a932155'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:35.288186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e5e87816974cb290dcd54f3a932155'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:35.304028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 853/1711] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:34 2022] DELETE /identity/v3/users/26e5e87816974cb290dcd54f3a932155 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:35.306301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:35.306597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:35.307132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:35.375777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:35.389526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:35.569040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 859/1712] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:35.624573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:35.626279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:35.717729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893a063-bc2f-47e7-b63b-c545be0dcf73 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:35.722517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0894e-d269-4657-8772-d7a2b17db421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:35.723302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0894e-d269-4657-8772-d7a2b17db421 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:35.724033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0894e-d269-4657-8772-d7a2b17db421 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:35.724501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0894e-d269-4657-8772-d7a2b17db421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:35.734331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:35.738734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:35.786728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8c4bd-d532-48d0-ab49-474109bce46d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:35.790897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0894e-d269-4657-8772-d7a2b17db421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:35.797694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0894e-d269-4657-8772-d7a2b17db421 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:35.805679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:35.811094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:35.811094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:35.811293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] PATH_INFO: `/v3/projects/7d15a770ed1e4bd490fcfe4a7adb18d3` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:35.816734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d15a770ed1e4bd490fcfe4a7adb18d3)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:35.819453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:35.829467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 854/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:35.933339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:35.948811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d15a770ed1e4bd490fcfe4a7adb18d3', 'request_id': 'req-234a1bf7-7484-49b0-921e-a3dc1057fdfb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:35.959348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d15a770ed1e4bd490fcfe4a7adb18d3', 'request_id': 'req-234a1bf7-7484-49b0-921e-a3dc1057fdfb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:35.977112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d15a770ed1e4bd490fcfe4a7adb18d3', 'request_id': 'req-234a1bf7-7484-49b0-921e-a3dc1057fdfb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.022215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.022507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.022806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:36.052291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] The token cache is being invalidate because project 7d15a770ed1e4bd490fcfe4a7adb18d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:36.052623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.054753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-234a1bf7-7484-49b0-921e-a3dc1057fdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.060869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 860/1714] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:35 2022] DELETE /identity/v3/projects/7d15a770ed1e4bd490fcfe4a7adb18d3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:36.065515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.065809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.066090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:36.101782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] MFA Rules not processed for user `409a723e3fe148e0aded87cbe5f5e254`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:36.103240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:36.117459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:36.118741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:36.307121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 855/1715] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:36.307121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:36.317471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:36.318734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 861/1716] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:36.320416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:36.322583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:36.346146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252764-da17-48e2-b1f2-b77e8e767e04 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:36.354172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:36.358677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.358960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.359798 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] PATH_INFO: `/v3/projects/48401fcf6c1a4ba2b45e12dfe8110e9b` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:36.362048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48401fcf6c1a4ba2b45e12dfe8110e9b)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:36.364043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:36.486237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48401fcf6c1a4ba2b45e12dfe8110e9b', 'request_id': 'req-1dddeeab-690f-4bff-8bd6-7da002c17936'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.497445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48401fcf6c1a4ba2b45e12dfe8110e9b', 'request_id': 'req-1dddeeab-690f-4bff-8bd6-7da002c17936'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.508269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48401fcf6c1a4ba2b45e12dfe8110e9b', 'request_id': 'req-1dddeeab-690f-4bff-8bd6-7da002c17936'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.527802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:36.538631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf845ef-9c35-41d1-8807-7d5427ed5a2e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:36.539519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] The token cache is being invalidate because project 48401fcf6c1a4ba2b45e12dfe8110e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:36.539839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.541467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1dddeeab-690f-4bff-8bd6-7da002c17936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.548143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 856/1717] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:36 2022] DELETE /identity/v3/projects/48401fcf6c1a4ba2b45e12dfe8110e9b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:36.548143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.548143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.548143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:36.594180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:36.595546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:36.693074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:36.693934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.694339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.695007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:36.700248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:36.706199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 857/1718] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:36.707440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:36.709311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:36.712281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:36.750934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd6d3-7b85-4fa0-9c33-de626e9090a2 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:36.765924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:36.767003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.767451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.767843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] PATH_INFO: `/v3/users/e2b6f31c733c4b91af475205f9a646b3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:36.771046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b6f31c733c4b91af475205f9a646b3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:36.773394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:36.823255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:36.825210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:36.840827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 862/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:36.842183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:36.855843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6899b-85cd-468b-93ac-d6ec83848de0 service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:36.874583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:36.883731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.883992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.884444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:36.885238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:36.885709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:36.888172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:36.895420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b6f31c733c4b91af475205f9a646b3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.908379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 863/1720] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:36.917145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:36.944684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b6f31c733c4b91af475205f9a646b3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.959803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b6f31c733c4b91af475205f9a646b3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.972829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e621b0-a1e8-4454-a186-2e280741305a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:36.973649 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b6f31c733c4b91af475205f9a646b3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.975313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-dca5b7fb-7cdb-41c7-a1f6-86ccbea3fa7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b6f31c733c4b91af475205f9a646b3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:36.993438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:36.998956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 858/1721] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:36 2022] DELETE /identity/v3/users/e2b6f31c733c4b91af475205f9a646b3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:36.999132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:36.999132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:36.999132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.003588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.005676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.053167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.054915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.055222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.067704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 864/1722] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:36 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:37.073233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.083898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.163249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] MFA Rules not processed for user `053edeb07da24a7a8678eb0ba7e0a915`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:37.166305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.330165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d1601-f5f9-416a-975e-e2390411c8ed admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.358592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.360795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.363331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.365492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.369215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.383673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.438895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 865/1723] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:37 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:46:37.446205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.458644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 859/1724] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:37.476994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.478612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.486232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788614-4a5e-4bd6-bc26-63cf5d7e9a19 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.499963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:37.516032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a533a-8945-42d7-90ce-480ecfa9f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.517831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a533a-8945-42d7-90ce-480ecfa9f4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.518419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a533a-8945-42d7-90ce-480ecfa9f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.521082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a533a-8945-42d7-90ce-480ecfa9f4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.521519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a533a-8945-42d7-90ce-480ecfa9f4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.523064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e2f30-e801-4506-bd6d-52b817b6ead2 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.532191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a533a-8945-42d7-90ce-480ecfa9f4c9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.551598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.552666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.553068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.553476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] PATH_INFO: `/v3/users/9c70085c476f4aa2880eb6e678432293` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.559544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c70085c476f4aa2880eb6e678432293)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.563275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 866/1725] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:37.565498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.568965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aac96-85e0-43c3-bda0-b8cf34e72470 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.570306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aac96-85e0-43c3-bda0-b8cf34e72470 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.570652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aac96-85e0-43c3-bda0-b8cf34e72470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.624352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-3b6aac96-85e0-43c3-bda0-b8cf34e72470 None None] MFA Rules not processed for user `053edeb07da24a7a8678eb0ba7e0a915`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:37.632744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3b6aac96-85e0-43c3-bda0-b8cf34e72470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.654751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 867/1726] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:37.656502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aac96-85e0-43c3-bda0-b8cf34e72470 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.685788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aac96-85e0-43c3-bda0-b8cf34e72470 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.693301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c70085c476f4aa2880eb6e678432293'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.701930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.702772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:37.703545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:37.704124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:37.706231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:37.708802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:37.720396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c70085c476f4aa2880eb6e678432293'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.730970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 868/1727] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:37.730970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.735877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c70085c476f4aa2880eb6e678432293'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.736843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.750753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c70085c476f4aa2880eb6e678432293'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.751551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c70085c476f4aa2880eb6e678432293'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:37.764858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 860/1728] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:37 2022] DELETE /identity/v3/users/9c70085c476f4aa2880eb6e678432293 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:46:37.766788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:37.772394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:37.818196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:37.911415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b822-4839-4aba-ad60-6e1ae3c7ee6b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.990295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c3011-8c53-48ef-9987-e4cff49df0f4 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:37.997941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973ed7f-ab30-4af3-9c4a-b99479e76933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:37.999511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ed7f-ab30-4af3-9c4a-b99479e76933 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.000083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ed7f-ab30-4af3-9c4a-b99479e76933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.000601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ed7f-ab30-4af3-9c4a-b99479e76933 admin admin] PATH_INFO: `/v3/projects/0ab2cbee30824308ae9146dc8833f420/users/23ce08cc101e4b6289be60b85af77abe/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.040977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ed7f-ab30-4af3-9c4a-b99479e76933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab2cbee30824308ae9146dc8833f420, user_id=23ce08cc101e4b6289be60b85af77abe, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.046158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ed7f-ab30-4af3-9c4a-b99479e76933 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:38.065762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 861/1729] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:37 2022] PUT /identity/v3/projects/0ab2cbee30824308ae9146dc8833f420/users/23ce08cc101e4b6289be60b85af77abe/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:38.067305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abc11a-b1b4-403c-8587-1ff56ec62d2c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.068008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abc11a-b1b4-403c-8587-1ff56ec62d2c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.068008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abc11a-b1b4-403c-8587-1ff56ec62d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.076131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:38.076966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.077360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.077762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.090248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.092204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-79abc11a-b1b4-403c-8587-1ff56ec62d2c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:38.094441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-79abc11a-b1b4-403c-8587-1ff56ec62d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.216099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:38.233767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.236123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:38.241535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 862/1730] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:38.243157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.243596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.245357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.257082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 869/1731] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:38.261936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.264911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.296962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec390c6a-b992-431a-bb56-a2093973e194 service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:38.308417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] MFA Rules not processed for user `c468cd8df1564441935e4edfba55ccc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:38.310299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.314064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:38.315234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.315722 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.316520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] PATH_INFO: `/v3/projects/875e16dcb2f9447e8ddc2b93177fd3d7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.318417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875e16dcb2f9447e8ddc2b93177fd3d7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:38.324594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:38.457118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875e16dcb2f9447e8ddc2b93177fd3d7', 'request_id': 'req-2db89cef-4457-4e12-8b4e-c462be1a5d96'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.477147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875e16dcb2f9447e8ddc2b93177fd3d7', 'request_id': 'req-2db89cef-4457-4e12-8b4e-c462be1a5d96'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.501141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:38.515369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875e16dcb2f9447e8ddc2b93177fd3d7', 'request_id': 'req-2db89cef-4457-4e12-8b4e-c462be1a5d96'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.542825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] The token cache is being invalidate because project 875e16dcb2f9447e8ddc2b93177fd3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:38.543509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.544486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2db89cef-4457-4e12-8b4e-c462be1a5d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:38.546655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 870/1732] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:38 2022] DELETE /identity/v3/projects/875e16dcb2f9447e8ddc2b93177fd3d7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:38.548272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:38.550052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:38.551879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:38.626602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] MFA Rules not processed for user `23ce08cc101e4b6289be60b85af77abe`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:38.628207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.796474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 863/1733] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:38.796474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.796474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.823912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 871/1734] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:38.825068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:38.829036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:38.839403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81026-6f8e-49be-91d5-fd149c81677d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.014867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.015998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.015998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.015998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] PATH_INFO: `/v3/projects/9f7d4a180a644aadaed3f9f2b7058982` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.016405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6acf57-3ace-46e0-a308-f1f0b500ae9d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.018371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7d4a180a644aadaed3f9f2b7058982)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.020343 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.026441 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5fabc-c539-44c2-9bd9-c9c3f4b48acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.028386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fabc-c539-44c2-9bd9-c9c3f4b48acf service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.029581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fabc-c539-44c2-9bd9-c9c3f4b48acf service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.029882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fabc-c539-44c2-9bd9-c9c3f4b48acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.035544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-99a5fabc-c539-44c2-9bd9-c9c3f4b48acf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.070612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5fabc-c539-44c2-9bd9-c9c3f4b48acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.073948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5fabc-c539-44c2-9bd9-c9c3f4b48acf service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.113940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 872/1735] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:39.122941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7d4a180a644aadaed3f9f2b7058982', 'request_id': 'req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:39.124209 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.124426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.124677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.132216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7d4a180a644aadaed3f9f2b7058982', 'request_id': 'req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:39.146095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7d4a180a644aadaed3f9f2b7058982', 'request_id': 'req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:39.170545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] The token cache is being invalidate because project 9f7d4a180a644aadaed3f9f2b7058982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:39.170843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:39.171958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:39.174754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 864/1736] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:38 2022] DELETE /identity/v3/projects/9f7d4a180a644aadaed3f9f2b7058982 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:39.175770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.176095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:39.182320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.182784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.232901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:39.346006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90cca9-5b83-4c74-b92e-ed1eb3138a83 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.353996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 873/1737] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:39.354219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.355771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.365863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56f982-3eaa-476c-8c8f-875efad67fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.366539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f982-3eaa-476c-8c8f-875efad67fef service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.366896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f982-3eaa-476c-8c8f-875efad67fef service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.367277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f982-3eaa-476c-8c8f-875efad67fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.374704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-bd56f982-3eaa-476c-8c8f-875efad67fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.390954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a32160-966a-4ab1-803e-e3db96f59cea None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.406131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e8d9-dff4-4270-a411-f0bbf0047482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.407752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e8d9-dff4-4270-a411-f0bbf0047482 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.409607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e8d9-dff4-4270-a411-f0bbf0047482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.409913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e8d9-dff4-4270-a411-f0bbf0047482 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.410640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9e8d9-dff4-4270-a411-f0bbf0047482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.414775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9e8d9-dff4-4270-a411-f0bbf0047482 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.458094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:39.475562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 874/1738] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:39.477149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f8132-283f-4696-beaa-689b3d4446ae None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.477592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f8132-283f-4696-beaa-689b3d4446ae None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.478026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f8132-283f-4696-beaa-689b3d4446ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.505169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56f982-3eaa-476c-8c8f-875efad67fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.506787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56f982-3eaa-476c-8c8f-875efad67fef service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.522931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2a5f8132-283f-4696-beaa-689b3d4446ae None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:39.524988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2a5f8132-283f-4696-beaa-689b3d4446ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.534996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 865/1739] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:39.536465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae234b0-e884-48f1-9cf6-f1e43ba15d84 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.536757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae234b0-e884-48f1-9cf6-f1e43ba15d84 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.537037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae234b0-e884-48f1-9cf6-f1e43ba15d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.588801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-aae234b0-e884-48f1-9cf6-f1e43ba15d84 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:39.590026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-aae234b0-e884-48f1-9cf6-f1e43ba15d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.733249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 875/1740] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:39.733249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f8132-283f-4696-beaa-689b3d4446ae None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.757215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f8132-283f-4696-beaa-689b3d4446ae None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.758856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 866/1741] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:39.760617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff987f-3524-48c6-a09b-34710c1c3d53 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.763105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.763518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff987f-3524-48c6-a09b-34710c1c3d53 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.763875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.763988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff987f-3524-48c6-a09b-34710c1c3d53 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.764163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.764575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.765431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.766332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 867/1742] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 23 13:46:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:39.767491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.768739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f824-ad98-4bf4-b846-f0e881c62f65 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.772353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f824-ad98-4bf4-b846-f0e881c62f65 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.772853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f824-ad98-4bf4-b846-f0e881c62f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.818263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-dee5f824-ad98-4bf4-b846-f0e881c62f65 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:39.826317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dee5f824-ad98-4bf4-b846-f0e881c62f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.829734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 876/1743] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:39.833233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.852155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 868/1744] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:39.856862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff001f-9e0f-40f5-ba48-33f6c7c69cc3 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.856862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff001f-9e0f-40f5-ba48-33f6c7c69cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.858172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff001f-9e0f-40f5-ba48-33f6c7c69cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.864458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714574-4a73-4157-816c-0c34940501ef admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.877364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.878127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.878424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.878712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.880954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:39.881278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:39.883080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:39.932195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 877/1745] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:39.933892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:39.963036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3e2ed-7f8f-4623-8e2d-28a86868f9b7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:39.984081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-57ff001f-9e0f-40f5-ba48-33f6c7c69cc3 None None] MFA Rules not processed for user `45c718c1e1024d73b6b635f77bacdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:39.985493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-57ff001f-9e0f-40f5-ba48-33f6c7c69cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:39.991841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:39.992563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:39.992860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:39.993148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:39.993900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.007008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.050399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 878/1746] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:40.051927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.092218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b626741-81bb-4ad2-9399-b9a9272f0ab7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.096127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:40.125285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 869/1747] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:40.126182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff001f-9e0f-40f5-ba48-33f6c7c69cc3 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.129735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec227ca-6683-4d4c-af14-3456ea11ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.136827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec227ca-6683-4d4c-af14-3456ea11ccff admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.137134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec227ca-6683-4d4c-af14-3456ea11ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.137423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec227ca-6683-4d4c-af14-3456ea11ccff admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.138733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec227ca-6683-4d4c-af14-3456ea11ccff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:40.139046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec227ca-6683-4d4c-af14-3456ea11ccff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.140756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff001f-9e0f-40f5-ba48-33f6c7c69cc3 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.147774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.148475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec227ca-6683-4d4c-af14-3456ea11ccff admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.148691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.149058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.149457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.150659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.153517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.203187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 879/1748] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:40.208069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.208368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.208663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.226490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 870/1749] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:40 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:40.227730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.337471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] MFA Rules not processed for user `cb2e8212194a4b56a6897702bd306b53`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:40.338763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:40.436329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691a612-fe9d-4fa9-950d-98ef938b86d2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.455086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.456098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.456491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.456856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] PATH_INFO: `/v3/projects/5738677e6cbd4ffa80ff42c7743b36e8/users/dd5dba30cacd431e8412a0af7de53a92/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.486896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5738677e6cbd4ffa80ff42c7743b36e8, user_id=dd5dba30cacd431e8412a0af7de53a92, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.490107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.532057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 880/1750] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:40.532057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.532057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:40.532427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 871/1751] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:40 2022] PUT /identity/v3/projects/5738677e6cbd4ffa80ff42c7743b36e8/users/dd5dba30cacd431e8412a0af7de53a92/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:40.532427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.626868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:40.677935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2edac-a1bf-4ab2-9865-e77c4fbd75e7 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.707189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb78bc-89d5-4001-b118-882332f1ed17 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.712801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.713479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.713766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.714045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.714749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.717290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.774968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 872/1752] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:40 2022] POST /identity/v3/projects => generated 409 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:40.778217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.795055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.796363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.796363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.796612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.815341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.817380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:40.836091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 881/1753] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:40.839246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:40.861737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:40.867108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4b81c-9928-4ca8-8616-6d26bc3ad4da service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.925548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0770d-e617-432b-b53a-97d7d32ce030 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:40.942714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6c3c6-6a14-47fd-ac40-8cbddf4a15f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:40.950129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c3c6-6a14-47fd-ac40-8cbddf4a15f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:40.951001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c3c6-6a14-47fd-ac40-8cbddf4a15f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:40.957760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c3c6-6a14-47fd-ac40-8cbddf4a15f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:40.960871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6c3c6-6a14-47fd-ac40-8cbddf4a15f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:40.978730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6c3c6-6a14-47fd-ac40-8cbddf4a15f8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.017468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.019450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.022433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.022433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.025008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:41.027957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 873/1754] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:40 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:41.029850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.033633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815563a9-884f-4a29-bd84-d1e5ffb7e456 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.033801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815563a9-884f-4a29-bd84-d1e5ffb7e456 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.034112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815563a9-884f-4a29-bd84-d1e5ffb7e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.056908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 882/1755] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:41.059026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.064608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.096859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-815563a9-884f-4a29-bd84-d1e5ffb7e456 None None] MFA Rules not processed for user `cb2e8212194a4b56a6897702bd306b53`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:41.104302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-815563a9-884f-4a29-bd84-d1e5ffb7e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.108515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af410-069b-49e8-bba5-9c5d52a71985 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.130928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.132275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.132677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.133091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] PATH_INFO: `/v3/projects/0f6889990ca7483291fd1a975faa3672` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.135614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6889990ca7483291fd1a975faa3672)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:41.153803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.233911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 874/1756] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:41.234839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815563a9-884f-4a29-bd84-d1e5ffb7e456 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.261505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815563a9-884f-4a29-bd84-d1e5ffb7e456 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.307573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6889990ca7483291fd1a975faa3672', 'request_id': 'req-3d0072ca-8cb9-463a-bb0d-228d03b216cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.319854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6889990ca7483291fd1a975faa3672', 'request_id': 'req-3d0072ca-8cb9-463a-bb0d-228d03b216cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.337100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6889990ca7483291fd1a975faa3672', 'request_id': 'req-3d0072ca-8cb9-463a-bb0d-228d03b216cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.378187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] The token cache is being invalidate because project 0f6889990ca7483291fd1a975faa3672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:41.379001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.382450 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:41.387660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 883/1757] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:41 2022] DELETE /identity/v3/projects/0f6889990ca7483291fd1a975faa3672 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:41.388873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.391847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.410479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.411100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.411423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.411710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.412417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:41.414448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.429688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:41.457314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 875/1758] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:41 2022] POST /identity/v3/users => generated 305 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:41.459263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.463719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.498993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43257855-880c-4434-8140-a0935bd8b844 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.524007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.525035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.525327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.525605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] PATH_INFO: `/v3/projects/5738677e6cbd4ffa80ff42c7743b36e8/users/dd5dba30cacd431e8412a0af7de53a92/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.528818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5738677e6cbd4ffa80ff42c7743b36e8, user_id=dd5dba30cacd431e8412a0af7de53a92, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:41.533017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:41.559160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 876/1759] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:41 2022] PUT /identity/v3/projects/5738677e6cbd4ffa80ff42c7743b36e8/users/dd5dba30cacd431e8412a0af7de53a92/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:41.564431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:41.573461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.672591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0072ca-8cb9-463a-bb0d-228d03b216cf admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.718854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:41.821027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f03df3-9d10-46b9-85bd-a5c32c8c17fe admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:41.843479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.844169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.844485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.844738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.850179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:41.988677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:41.989437 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:41.991790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:41.993079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:41.998503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.019368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.036186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.038557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.082914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 877/1760] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:42.088597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.094825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.126303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 884/1761] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 738 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:42.127333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.134481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d021b-ff8b-40d7-9c2b-804968e103cf service nova] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.141835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.144050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.145304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.145814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.146310 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] PATH_INFO: `/v3/users/a0a25c14c72a40eb8fe8db7fad5dbcee` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.149906 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a25c14c72a40eb8fe8db7fad5dbcee)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.155292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.230810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a44e-3f8c-4882-911a-ebb266c976bd admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.254283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23c4a7-153e-401c-ba6a-c7e292d4617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.263877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c4a7-153e-401c-ba6a-c7e292d4617c admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.267724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c4a7-153e-401c-ba6a-c7e292d4617c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.268108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c4a7-153e-401c-ba6a-c7e292d4617c admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.268930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23c4a7-153e-401c-ba6a-c7e292d4617c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.270590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23c4a7-153e-401c-ba6a-c7e292d4617c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.312128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 885/1762] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:42.315889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.316196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.316490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.354060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a25c14c72a40eb8fe8db7fad5dbcee'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.378320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a25c14c72a40eb8fe8db7fad5dbcee'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.391789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a25c14c72a40eb8fe8db7fad5dbcee'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.411019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a25c14c72a40eb8fe8db7fad5dbcee'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.412937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-38b514bb-a952-4fc8-89e2-04dd3211c7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a25c14c72a40eb8fe8db7fad5dbcee'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:42.424991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] MFA Rules not processed for user `dd5dba30cacd431e8412a0af7de53a92`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:42.426551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.432365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 878/1763] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:42 2022] DELETE /identity/v3/users/a0a25c14c72a40eb8fe8db7fad5dbcee => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:42.436569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a7bf-d6a2-44b8-a1e0-82b6b75ac68b None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.437592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a7bf-d6a2-44b8-a1e0-82b6b75ac68b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.439114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a7bf-d6a2-44b8-a1e0-82b6b75ac68b None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.442066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 879/1764] 10.222.0.23 () {54 vars in 960 bytes} [Thu Jun 23 13:46:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:42.444110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a7bf-d6a2-44b8-a1e0-82b6b75ac68b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.452098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f0c3a7bf-d6a2-44b8-a1e0-82b6b75ac68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.647545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:42.681585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a7bf-d6a2-44b8-a1e0-82b6b75ac68b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.691904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42a0d4-8687-4c1d-99d6-63c5bf8713c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.692778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a0d4-8687-4c1d-99d6-63c5bf8713c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.693309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a0d4-8687-4c1d-99d6-63c5bf8713c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.693705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a0d4-8687-4c1d-99d6-63c5bf8713c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.694570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42a0d4-8687-4c1d-99d6-63c5bf8713c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.696353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42a0d4-8687-4c1d-99d6-63c5bf8713c1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.731055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 886/1765] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:42.732803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:42.739168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 880/1766] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:42.742709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf5f8-55b1-4277-ae4c-ea2e8b66e0f5 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.743126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf5f8-55b1-4277-ae4c-ea2e8b66e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.745916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf5f8-55b1-4277-ae4c-ea2e8b66e0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.756142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.787749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56534485-ffa7-434e-a26e-271dd0d0ca44 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:42.799991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171b6b7-28fc-49f7-9210-6771c7d489f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:42.801813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2d7cf5f8-55b1-4277-ae4c-ea2e8b66e0f5 None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:42.802254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b6b7-28fc-49f7-9210-6771c7d489f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.803153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b6b7-28fc-49f7-9210-6771c7d489f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.804041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b6b7-28fc-49f7-9210-6771c7d489f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.809630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2d7cf5f8-55b1-4277-ae4c-ea2e8b66e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.812949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171b6b7-28fc-49f7-9210-6771c7d489f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:42.815097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171b6b7-28fc-49f7-9210-6771c7d489f8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:42.863577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 887/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:42.865384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:42.867127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:42.867640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:42.903087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] MFA Rules not processed for user `409a723e3fe148e0aded87cbe5f5e254`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:42.905708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:42.926269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:43.016100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 881/1768] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Jun 23 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:43.017773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf5f8-55b1-4277-ae4c-ea2e8b66e0f5 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.033140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf5f8-55b1-4277-ae4c-ea2e8b66e0f5 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.039154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.041368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.041874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.042371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] PATH_INFO: `/v3/projects/295d426515774c5c8013f122562cc112/users/1c9a26bd623f4ab48d96f9e8ccd6ac75/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.066169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 888/1769] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:43.066169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.068067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.099108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=295d426515774c5c8013f122562cc112, user_id=1c9a26bd623f4ab48d96f9e8ccd6ac75, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.103105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.127416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 882/1770] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:43 2022] PUT /identity/v3/projects/295d426515774c5c8013f122562cc112/users/1c9a26bd623f4ab48d96f9e8ccd6ac75/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:43.128699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.315790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882b584-5b65-4ae6-8a77-53440d729d66 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.452045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f13d0-97a5-41de-95de-efc53005c29f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.455976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a323b26-113c-467a-ab34-fdd85855aaf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.456654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323b26-113c-467a-ab34-fdd85855aaf1 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.457525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323b26-113c-467a-ab34-fdd85855aaf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.458103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323b26-113c-467a-ab34-fdd85855aaf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.475955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.476892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.477196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.486914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] PATH_INFO: `/v3/projects/c24f7759957148ad81ac65d1990697cc/users/ed653441b7e0467f893e26d489b3add5/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.514489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24f7759957148ad81ac65d1990697cc, user_id=ed653441b7e0467f893e26d489b3add5, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.518154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.541250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 883/1771] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:43 2022] PUT /identity/v3/projects/c24f7759957148ad81ac65d1990697cc/users/ed653441b7e0467f893e26d489b3add5/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:43.542537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:43.645676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:43.668743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a323b26-113c-467a-ab34-fdd85855aaf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.671803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a323b26-113c-467a-ab34-fdd85855aaf1 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.702909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 889/1772] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:43.704496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98f11-4b3b-4518-8d85-3e65175e5ef3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.706546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98f11-4b3b-4518-8d85-3e65175e5ef3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.707629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98f11-4b3b-4518-8d85-3e65175e5ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.720879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdb223-cd15-4482-ac9f-6b93ccba5d42 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:43.732970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b7507-ce17-42b2-87a4-ccd6f4577196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:43.733757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b7507-ce17-42b2-87a4-ccd6f4577196 service placement] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.734173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b7507-ce17-42b2-87a4-ccd6f4577196 service placement] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.734555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b7507-ce17-42b2-87a4-ccd6f4577196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.737253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e62b7507-ce17-42b2-87a4-ccd6f4577196 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.766069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b7507-ce17-42b2-87a4-ccd6f4577196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:43.772584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b7507-ce17-42b2-87a4-ccd6f4577196 service placement] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:43.775479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-91f98f11-4b3b-4518-8d85-3e65175e5ef3 None None] MFA Rules not processed for user `1c9a26bd623f4ab48d96f9e8ccd6ac75`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:43.777052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-91f98f11-4b3b-4518-8d85-3e65175e5ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.803390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 884/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:43.806944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671ecb-b376-47c5-b6cd-19be656284c0 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.807269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671ecb-b376-47c5-b6cd-19be656284c0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.813791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671ecb-b376-47c5-b6cd-19be656284c0 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.814947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:43.817165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 885/1774] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 23 13:46:43 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:43.822795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8556d9-0a05-4cee-ab2d-3a9553e6c114 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.823104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8556d9-0a05-4cee-ab2d-3a9553e6c114 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.823420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8556d9-0a05-4cee-ab2d-3a9553e6c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.895106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-da8556d9-0a05-4cee-ab2d-3a9553e6c114 None None] MFA Rules not processed for user `ed653441b7e0467f893e26d489b3add5`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:43.896495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-da8556d9-0a05-4cee-ab2d-3a9553e6c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:43.930536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 890/1775] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:43.932158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:43.934898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:43.936051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:43.985160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] MFA Rules not processed for user `45c718c1e1024d73b6b635f77bacdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:43.990748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.042356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 886/1776] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:44.042356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8556d9-0a05-4cee-ab2d-3a9553e6c114 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.114784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8556d9-0a05-4cee-ab2d-3a9553e6c114 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:44.130450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:44.140410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.140704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.141819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.143868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.152979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 891/1777] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:44.155538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.157321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.185419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933330f-944a-4cbf-aba4-4ef512541078 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:44.196200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:44.196890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.197181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.197466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.217371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:44.225926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:44.269794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 892/1778] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:44.271152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.273446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.311314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:44.313087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:44.355509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 887/1779] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:44.357471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.374050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30114-fd2e-45bf-a65c-55371777410c service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:44.395848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:44.401265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:44.405926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.407745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.408409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] PATH_INFO: `/v3/projects/e84e3720bdd54a939b599e89ce0f79d3` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.411776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84e3720bdd54a939b599e89ce0f79d3)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:44.413753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:44.503237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4cb3-afe1-4d1c-bdf3-625028d0ad93 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:44.520274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:44.522393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.522730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.526307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.527885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:44.538288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:44.579948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84e3720bdd54a939b599e89ce0f79d3', 'request_id': 'req-26d28a7a-737b-41e4-90a8-66c75654c139'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:44.603869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84e3720bdd54a939b599e89ce0f79d3', 'request_id': 'req-26d28a7a-737b-41e4-90a8-66c75654c139'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:44.609793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:44.620645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84e3720bdd54a939b599e89ce0f79d3', 'request_id': 'req-26d28a7a-737b-41e4-90a8-66c75654c139'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:44.621723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 888/1780] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:44 2022] POST /identity/v3/projects => generated 409 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:44.624035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.628457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.656646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] The token cache is being invalidate because project e84e3720bdd54a939b599e89ce0f79d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:44.657014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:44.662946 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:44.665036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 893/1781] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:44 2022] DELETE /identity/v3/projects/e84e3720bdd54a939b599e89ce0f79d3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:44.670494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.676930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.758027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec73d1-3491-413c-b44e-1c0664db9271 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:44.766265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:44.767264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.767618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.768166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.771401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.797532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:44.803184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:44.833930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 889/1782] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:44.838375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:44.844385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:44.849349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d28a7a-737b-41e4-90a8-66c75654c139 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:44.923454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:44.925859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:44.926546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:44.928900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] PATH_INFO: `/v3/users/1c9a26bd623f4ab48d96f9e8ccd6ac75` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:44.931614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9a26bd623f4ab48d96f9e8ccd6ac75)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:44.934869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:45.020578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9a26bd623f4ab48d96f9e8ccd6ac75'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:45.054671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb974a-c4aa-4d34-aafa-1328045c9900 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:45.075762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9a26bd623f4ab48d96f9e8ccd6ac75'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:45.076761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9a26bd623f4ab48d96f9e8ccd6ac75'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:45.083823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb536db-01c6-4627-8854-23f40716771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:45.086120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb536db-01c6-4627-8854-23f40716771e admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.086420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb536db-01c6-4627-8854-23f40716771e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.086714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb536db-01c6-4627-8854-23f40716771e admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.089836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb536db-01c6-4627-8854-23f40716771e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:45.095366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9a26bd623f4ab48d96f9e8ccd6ac75'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:45.098770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb536db-01c6-4627-8854-23f40716771e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:45.113890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2ff46afb-f4aa-43fb-881d-6e5dd500525f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9a26bd623f4ab48d96f9e8ccd6ac75'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:45.128855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 894/1783] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:44 2022] DELETE /identity/v3/users/1c9a26bd623f4ab48d96f9e8ccd6ac75 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:45.128855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.128855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.128855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.173318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:45.176377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:45.185528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 890/1784] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:44 2022] POST /identity/v3/users => generated 311 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:45.187020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.187362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.187972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.215344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:45.234940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:45.240747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:45.336979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:45.438525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 891/1785] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:45.438525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:45.438525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:45.444248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 895/1786] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:45.454159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:45.457681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:45.469769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe6f7-2511-49d7-9388-c0fd24ff00f9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:45.503914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed449293-146c-4140-b412-c9302c08edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:45.504821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed449293-146c-4140-b412-c9302c08edb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.505128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed449293-146c-4140-b412-c9302c08edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.505588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed449293-146c-4140-b412-c9302c08edb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.506592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed449293-146c-4140-b412-c9302c08edb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:45.509431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed449293-146c-4140-b412-c9302c08edb4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:45.560336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 892/1787] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:45.561989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5248-7eec-4667-a866-aae2976ee87f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.563880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5248-7eec-4667-a866-aae2976ee87f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.563880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5248-7eec-4667-a866-aae2976ee87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.616905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-58df5248-7eec-4667-a866-aae2976ee87f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:45.618292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-58df5248-7eec-4667-a866-aae2976ee87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:45.648042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 893/1788] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:45.651543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d885-9a58-4658-ad99-6f1445a375a8 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:45.652054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5248-7eec-4667-a866-aae2976ee87f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:45.667006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:45.667739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.668068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.668412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.675857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5248-7eec-4667-a866-aae2976ee87f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:45.702000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e8ebb-6dbc-4b78-8a36-668f000b6d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:45.702916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8ebb-6dbc-4b78-8a36-668f000b6d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.703234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8ebb-6dbc-4b78-8a36-668f000b6d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.703508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8ebb-6dbc-4b78-8a36-668f000b6d8c admin admin] PATH_INFO: `/v3/projects/654149efd56f462db21684687a822071/users/d94d4637fdb24897b26b797172db1b64/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.710763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:45.713149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:45.749223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 896/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:45.750325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:45.762330 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e8ebb-6dbc-4b78-8a36-668f000b6d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=654149efd56f462db21684687a822071, user_id=d94d4637fdb24897b26b797172db1b64, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:45.784914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e8ebb-6dbc-4b78-8a36-668f000b6d8c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:45.809541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077717-a86c-44a5-8177-4c8025eb14a9 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:45.818868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:45.821179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.821306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.821496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.832820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:45.835083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 894/1790] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:45 2022] PUT /identity/v3/projects/654149efd56f462db21684687a822071/users/d94d4637fdb24897b26b797172db1b64/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:45.836770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:45.840652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62325a-6e94-4186-9a8a-971b087824c5 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:45.840950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62325a-6e94-4186-9a8a-971b087824c5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:45.841280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62325a-6e94-4186-9a8a-971b087824c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:45.881104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:45.907609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5b62325a-6e94-4186-9a8a-971b087824c5 None None] MFA Rules not processed for user `c468cd8df1564441935e4edfba55ccc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:45.909067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5b62325a-6e94-4186-9a8a-971b087824c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:45.977114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 897/1791] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:45.979635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:46.030765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41d90b-b128-4c39-984f-28a43553484b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:46.177363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 895/1792] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:46.178599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62325a-6e94-4186-9a8a-971b087824c5 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:46.328363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbd21f-6ae6-4ff0-933b-df52f74a358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:46.328735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd21f-6ae6-4ff0-933b-df52f74a358f admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:46.329031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd21f-6ae6-4ff0-933b-df52f74a358f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:46.329325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd21f-6ae6-4ff0-933b-df52f74a358f admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:46.330588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbd21f-6ae6-4ff0-933b-df52f74a358f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:46.331801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbd21f-6ae6-4ff0-933b-df52f74a358f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:46.357986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62325a-6e94-4186-9a8a-971b087824c5 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:46.365880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:46.365880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:46.365880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:46.366243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 898/1793] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:46.366449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:46.367498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03130a-0af8-4f4b-926b-ec6e8a0e0a8c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:46.367628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:46.367810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03130a-0af8-4f4b-926b-ec6e8a0e0a8c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:46.368096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03130a-0af8-4f4b-926b-ec6e8a0e0a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:46.370306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:46.452850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-fe03130a-0af8-4f4b-926b-ec6e8a0e0a8c None None] MFA Rules not processed for user `cb2e8212194a4b56a6897702bd306b53`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:46.454100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-fe03130a-0af8-4f4b-926b-ec6e8a0e0a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:46.477210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 896/1794] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:46 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:46.478275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:46.558003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:46.618989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:46.680203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 899/1795] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:46.681140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03130a-0af8-4f4b-926b-ec6e8a0e0a8c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:46.703920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03130a-0af8-4f4b-926b-ec6e8a0e0a8c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:46.795101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb5c8-c96f-4fdb-881b-fe5e54e08fb8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:46.825578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:46.826739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:46.826739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:46.839679 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] PATH_INFO: `/v3/projects/654149efd56f462db21684687a822071/users/d94d4637fdb24897b26b797172db1b64/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:46.858940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:46.859693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:46.859985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:46.860092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654149efd56f462db21684687a822071, user_id=d94d4637fdb24897b26b797172db1b64, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:46.860288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:46.860975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:46.863526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:46.884778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:46.907187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 900/1796] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:46 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:46.911484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:46.938288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a312237-5a5d-44f5-a917-78d27116ce1f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:46.966742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 897/1797] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:46 2022] PUT /identity/v3/projects/654149efd56f462db21684687a822071/users/d94d4637fdb24897b26b797172db1b64/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:46.966742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:46.980514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:47.160392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809473-3d11-4f6a-9a27-d165eb8121d4 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:47.196177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:47.197705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.201182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.203751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] PATH_INFO: `/v3/projects/295d426515774c5c8013f122562cc112` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.207363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=295d426515774c5c8013f122562cc112)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:47.210451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:47.245307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e8732-24c1-4835-8692-c4833d268615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:47.255030 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e8732-24c1-4835-8692-c4833d268615 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.256024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e8732-24c1-4835-8692-c4833d268615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.256306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e8732-24c1-4835-8692-c4833d268615 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.257102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e8732-24c1-4835-8692-c4833d268615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:47.258761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e8732-24c1-4835-8692-c4833d268615 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:47.287821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 901/1798] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:47.289427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff78b-4131-460a-83e9-a36c096ff62f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.289737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff78b-4131-460a-83e9-a36c096ff62f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.294860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff78b-4131-460a-83e9-a36c096ff62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.338208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295d426515774c5c8013f122562cc112', 'request_id': 'req-98743122-5937-4054-b6a0-e9406ac5e9ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:47.356943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295d426515774c5c8013f122562cc112', 'request_id': 'req-98743122-5937-4054-b6a0-e9406ac5e9ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:47.374515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295d426515774c5c8013f122562cc112', 'request_id': 'req-98743122-5937-4054-b6a0-e9406ac5e9ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:47.395640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ad8ff78b-4131-460a-83e9-a36c096ff62f None None] MFA Rules not processed for user `d94d4637fdb24897b26b797172db1b64`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:47.398071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ad8ff78b-4131-460a-83e9-a36c096ff62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:47.399870 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] The token cache is being invalidate because project 295d426515774c5c8013f122562cc112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:46:47.400210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:47.401210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:47.409053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 898/1799] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:46:46 2022] DELETE /identity/v3/projects/295d426515774c5c8013f122562cc112 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:47.410133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:47.414819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:47.531283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:47.543396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:47.552148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743122-5937-4054-b6a0-e9406ac5e9ca admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:47.558229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1201e7-9f8f-4769-83d8-eed1c589eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:47.558927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1201e7-9f8f-4769-83d8-eed1c589eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.559258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1201e7-9f8f-4769-83d8-eed1c589eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.559543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1201e7-9f8f-4769-83d8-eed1c589eb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.560402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 902/1800] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:47.560549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1201e7-9f8f-4769-83d8-eed1c589eb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:47.562200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1201e7-9f8f-4769-83d8-eed1c589eb8b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:47.562456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.562873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.563392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.578170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 899/1801] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:47.579713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e34a7-508c-4575-adaa-a2a0f4ee0769 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.580087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e34a7-508c-4575-adaa-a2a0f4ee0769 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.580660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e34a7-508c-4575-adaa-a2a0f4ee0769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.592883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:47.594362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:47.613230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 903/1802] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:47.615583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:47.617001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:47.624324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-059e34a7-508c-4575-adaa-a2a0f4ee0769 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:47.629591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-059e34a7-508c-4575-adaa-a2a0f4ee0769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:47.741467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9a799-8994-42f5-96d9-1aba9c18d98a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:47.748581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a6ac4-6dfe-413b-8801-d3324d20615c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:47.749745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6ac4-6dfe-413b-8801-d3324d20615c service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.750286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6ac4-6dfe-413b-8801-d3324d20615c service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.750799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6ac4-6dfe-413b-8801-d3324d20615c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.764180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a6ac4-6dfe-413b-8801-d3324d20615c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:47.767039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a6ac4-6dfe-413b-8801-d3324d20615c service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:47.769190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 900/1803] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:47.787752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 904/1804] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:47.789516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e34a7-508c-4575-adaa-a2a0f4ee0769 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:47.791393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e2f8c-8ca1-4188-8767-84e61b83af81 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.792305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e2f8c-8ca1-4188-8767-84e61b83af81 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.794780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e2f8c-8ca1-4188-8767-84e61b83af81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.821545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-fa1e2f8c-8ca1-4188-8767-84e61b83af81 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:47.823287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-fa1e2f8c-8ca1-4188-8767-84e61b83af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:47.834506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 905/1805] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:47.837846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e34a7-508c-4575-adaa-a2a0f4ee0769 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:47.841852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e2f8c-8ca1-4188-8767-84e61b83af81 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:47.848644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3038c6d-36b7-4a6d-9b94-a2300ec43b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:47.850049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038c6d-36b7-4a6d-9b94-a2300ec43b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.850505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038c6d-36b7-4a6d-9b94-a2300ec43b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.851074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038c6d-36b7-4a6d-9b94-a2300ec43b77 admin admin] PATH_INFO: `/v3/projects/46dd75c040294046bab588ffee37e187/users/15e767bb9ca74bd099643e634b211085/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.859684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e2f8c-8ca1-4188-8767-84e61b83af81 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:47.875258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3038c6d-36b7-4a6d-9b94-a2300ec43b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dd75c040294046bab588ffee37e187, user_id=15e767bb9ca74bd099643e634b211085, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:47.879790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3038c6d-36b7-4a6d-9b94-a2300ec43b77 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:47.881633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:47.882652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.885095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.885636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.886762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:46:47.887793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:47.890420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:47.931403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 906/1807] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:46:47.932446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:47.938270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 901/1807] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:47 2022] PUT /identity/v3/projects/46dd75c040294046bab588ffee37e187/users/15e767bb9ca74bd099643e634b211085/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:47.940317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726ca18-a7f3-47f0-8cb0-b49a8e7152fb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:47.940615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726ca18-a7f3-47f0-8cb0-b49a8e7152fb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:47.940938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726ca18-a7f3-47f0-8cb0-b49a8e7152fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:47.967456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e007f-84c9-4f1e-b4aa-448f44e6c609 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:47.974982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2726ca18-a7f3-47f0-8cb0-b49a8e7152fb None None] MFA Rules not processed for user `15e767bb9ca74bd099643e634b211085`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:47.976599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2726ca18-a7f3-47f0-8cb0-b49a8e7152fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:48.071000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 902/1808] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:48.071990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726ca18-a7f3-47f0-8cb0-b49a8e7152fb None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:48.157360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:48.173069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726ca18-a7f3-47f0-8cb0-b49a8e7152fb None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:48.178985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:48.179823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:48.180171 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:48.180576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:48.181321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:48.183607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:48.216592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:48.217219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:48.217509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:48.217790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:48.218499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:48.222350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:48.241485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 903/1809] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:48 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:48.249223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:48.252788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:48.289249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 907/1810] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:46:47 2022] POST /identity/v3/projects => generated 383 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:48.289895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:48.412415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316102f-83b1-4eff-aeb3-e5ed7f0e4fc1 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:48.436306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:48.436987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:48.437272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:48.437554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:48.444220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:48.481705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:48.522666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555565ed-75ca-4b63-921b-88b15227a7d0 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:48.695831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:48.697308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:48.746934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 908/1811] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:48.748578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:48.831440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:48.832135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:48.832424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:48.832706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:48.909792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e2d1a-e59a-4d31-97f9-15d05ac38420 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:48.922700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:48.925157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:48.925463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:48.927092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:48.927906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:48.932499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:48.993933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 909/1812] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:48 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:48.999141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.027543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41292b-0b28-42a2-aa25-0670cbc6a4e0 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.035930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.037578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.037875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.038544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.040149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.059288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.072473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.093155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.116816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 904/1814] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:46:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 873 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:49.118345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.119093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 910/1813] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:46:48 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:46:49.121427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.144335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab998d4-0468-49fc-ae84-2949f0bc471e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.148466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307285-b41c-4906-9ab6-5d25acf6fdba service swift] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.167189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.168615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.168938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.172073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.174543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.176591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.178605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.184290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.199886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.201358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.204951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.210079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.219377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 905/1815] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:49.220542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.254604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5f16-389c-4a79-b870-24f68fceb92a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.273409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.286212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.286514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.288749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] PATH_INFO: `/v3/projects/0c4c584dbcc14b53878019361e6f6e71/users/6eef735e837d48d383fc581242673922/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.298811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 911/1816] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:49.302544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.330764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:49.355732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02edb-8312-44e8-b59f-1314c49a6692 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.365599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4c584dbcc14b53878019361e6f6e71, user_id=6eef735e837d48d383fc581242673922, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.368981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.380112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.386361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.386677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.386947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.391962 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.398493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.429620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 906/1817] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:49 2022] PUT /identity/v3/projects/0c4c584dbcc14b53878019361e6f6e71/users/6eef735e837d48d383fc581242673922/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:49.430762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.448795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 912/1818] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:49.456072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.520488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817a09-ce12-47e9-a2cd-fabe9bcc8ad9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.683920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3ab34-7690-4884-93d2-dff5ed020c46 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.710054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.710815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.711114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.711444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.722386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.724652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.783121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 907/1819] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:46:49.793344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:49.826021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c0d40-cb27-4952-8471-a403dd9a711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.830363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c0d40-cb27-4952-8471-a403dd9a711f admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.830684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c0d40-cb27-4952-8471-a403dd9a711f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.841285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c0d40-cb27-4952-8471-a403dd9a711f admin admin] PATH_INFO: `/v3/projects/8f4f31be71194e9dbee1ca61db10bf65/users/d9653434abb946af9aecef7051339836/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.842692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c281e-47e2-4124-919c-f81c480654a8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:49.862764 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:49.862997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dfa4a-4387-458c-94f3-dfaf611acf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:49.863978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dfa4a-4387-458c-94f3-dfaf611acf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.864387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dfa4a-4387-458c-94f3-dfaf611acf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.864731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dfa4a-4387-458c-94f3-dfaf611acf7e admin admin] PATH_INFO: `/v3/projects/0c4c584dbcc14b53878019361e6f6e71/users/6eef735e837d48d383fc581242673922/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.881562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dfa4a-4387-458c-94f3-dfaf611acf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4c584dbcc14b53878019361e6f6e71, user_id=6eef735e837d48d383fc581242673922, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.892177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dfa4a-4387-458c-94f3-dfaf611acf7e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.912244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c0d40-cb27-4952-8471-a403dd9a711f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4f31be71194e9dbee1ca61db10bf65, user_id=d9653434abb946af9aecef7051339836, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:49.942806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 908/1820] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:49 2022] PUT /identity/v3/projects/0c4c584dbcc14b53878019361e6f6e71/users/6eef735e837d48d383fc581242673922/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:49.944443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:49.944736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:49.945030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:49.949901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c0d40-cb27-4952-8471-a403dd9a711f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:49.984875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] MFA Rules not processed for user `6eef735e837d48d383fc581242673922`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:49.986149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:50.010825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 913/1821] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:46:49 2022] PUT /identity/v3/projects/8f4f31be71194e9dbee1ca61db10bf65/users/d9653434abb946af9aecef7051339836/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:50.014156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366adbae-468f-4cb1-bc78-725fc95fce2c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:50.014457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366adbae-468f-4cb1-bc78-725fc95fce2c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:50.014743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366adbae-468f-4cb1-bc78-725fc95fce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:50.085252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-366adbae-468f-4cb1-bc78-725fc95fce2c None None] MFA Rules not processed for user `d9653434abb946af9aecef7051339836`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:50.086506 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-366adbae-468f-4cb1-bc78-725fc95fce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:50.223954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 909/1822] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:50.225048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:50.227456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:50.227700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 914/1823] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:50.457926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d797c67-76ab-41e3-9158-070214c2f451 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:50.490986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:50.497172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:50.497573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:50.497773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:50.520853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:50.526473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:50.532250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:50.552358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 910/1824] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:50.602016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366adbae-468f-4cb1-bc78-725fc95fce2c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:50.626613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366adbae-468f-4cb1-bc78-725fc95fce2c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:50.641248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d97fdd-3cc8-4b86-a112-d8447a82ac7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:50.649935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d97fdd-3cc8-4b86-a112-d8447a82ac7c service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:50.650285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d97fdd-3cc8-4b86-a112-d8447a82ac7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:50.650556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d97fdd-3cc8-4b86-a112-d8447a82ac7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:50.683315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d97fdd-3cc8-4b86-a112-d8447a82ac7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:50.688838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d97fdd-3cc8-4b86-a112-d8447a82ac7c service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:50.737488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 915/1825] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:51.847138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:51.857450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e11dee-c55d-47a3-9072-b5648f7d1e07 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:51.873204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:51.873899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:51.877003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:51.877305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:52.007184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:52.009463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:52.026963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 911/1826] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:52.237849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651376-0221-44af-8915-9c2c1b82cb7d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:52.238515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651376-0221-44af-8915-9c2c1b82cb7d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:52.239044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651376-0221-44af-8915-9c2c1b82cb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:52.304791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-7e651376-0221-44af-8915-9c2c1b82cb7d None None] MFA Rules not processed for user `45c718c1e1024d73b6b635f77bacdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:52.308645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7e651376-0221-44af-8915-9c2c1b82cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:52.437936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 916/1827] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 23 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:52.577289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:52.579245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:52.602904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f1b8e-41e3-4d75-91c1-c144a31adc93 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:52.632098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17217bc-4edb-4c66-927a-42c0b2c6a9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:52.633056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17217bc-4edb-4c66-927a-42c0b2c6a9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:52.633503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17217bc-4edb-4c66-927a-42c0b2c6a9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:52.633933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17217bc-4edb-4c66-927a-42c0b2c6a9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:52.661547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17217bc-4edb-4c66-927a-42c0b2c6a9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:52.666813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17217bc-4edb-4c66-927a-42c0b2c6a9b4 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:52.709573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 912/1828] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:55.813470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e651376-0221-44af-8915-9c2c1b82cb7d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:55.981182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e651376-0221-44af-8915-9c2c1b82cb7d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:55.993436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:55.993436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:55.993436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:55.993436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] PATH_INFO: `/v3/users/15e767bb9ca74bd099643e634b211085` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:55.994710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e767bb9ca74bd099643e634b211085)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:56.000502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:56.020105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:56.095993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e767bb9ca74bd099643e634b211085'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:56.141942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e767bb9ca74bd099643e634b211085'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:56.143161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e767bb9ca74bd099643e634b211085'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:56.155731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e767bb9ca74bd099643e634b211085'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:56.165572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e767bb9ca74bd099643e634b211085'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:56.197709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 917/1829] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:55 2022] DELETE /identity/v3/users/15e767bb9ca74bd099643e634b211085 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:56.202292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:56.203954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:56.204390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:56.229077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:56.230433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:56.369511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 913/1830] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:56.429911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:56.431611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:56.598774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ef5a-555f-445f-b377-5170dd658803 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:56.625689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa909e5-586b-47a4-a30c-51fc2d7c01e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:56.625689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa909e5-586b-47a4-a30c-51fc2d7c01e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:56.625689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa909e5-586b-47a4-a30c-51fc2d7c01e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:56.625689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa909e5-586b-47a4-a30c-51fc2d7c01e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:56.652790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa909e5-586b-47a4-a30c-51fc2d7c01e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:56.654895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa909e5-586b-47a4-a30c-51fc2d7c01e7 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:56.691830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 918/1831] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:56.935607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:56.937221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:56.963125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000967b9-a7ae-4951-8360-c7ca6938a637 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:56.979229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:56.980128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:56.980457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:56.980822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] PATH_INFO: `/v3/users/ed653441b7e0467f893e26d489b3add5` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:56.984439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed653441b7e0467f893e26d489b3add5)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:56.986413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:57.064646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845f6f-ce6f-491d-8486-81dfcf82987d None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:57.065177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845f6f-ce6f-491d-8486-81dfcf82987d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:57.065250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845f6f-ce6f-491d-8486-81dfcf82987d None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:57.066738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 919/1832] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:46:57.140362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed653441b7e0467f893e26d489b3add5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:57.186327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed653441b7e0467f893e26d489b3add5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:57.204814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed653441b7e0467f893e26d489b3add5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:57.211782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:57.226068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed653441b7e0467f893e26d489b3add5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:57.226904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-308e336d-6dbf-4f35-b785-d8d698fe6a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed653441b7e0467f893e26d489b3add5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:57.244779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 914/1833] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:56 2022] DELETE /identity/v3/users/ed653441b7e0467f893e26d489b3add5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:57.248704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:57.249004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:57.249291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:57.276164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:57.280769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:57.305418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:57.305714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:57.306164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:57.346866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:57.350118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:57.485433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 920/1834] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:57.531780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:57.533244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:57.634704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:57.661218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 915/1835] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:46:57.689213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996d49e-2a29-4a2e-9aac-29f097161f30 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:57.709953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:57.710840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:57.711249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:57.711633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:57.720347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:57.724228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:57.740203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:57.741982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:57.762724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09039e2b-2b24-4e19-97a7-a8c475dcc9ff None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:57.772169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 921/1836] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:46:57.786953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0ea7-3ba8-4904-9ace-408d58e48436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:57.787956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ea7-3ba8-4904-9ace-408d58e48436 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:57.788505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ea7-3ba8-4904-9ace-408d58e48436 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:57.789004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ea7-3ba8-4904-9ace-408d58e48436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:57.817704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0ea7-3ba8-4904-9ace-408d58e48436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:57.821782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0ea7-3ba8-4904-9ace-408d58e48436 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:57.875244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 916/1837] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:46:58.952291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:58.953848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:58.981663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d68c5f-603f-4b08-b501-2c23826c8316 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:46:59.002057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:46:59.004009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:59.004964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:59.005613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] PATH_INFO: `/v3/users/d9653434abb946af9aecef7051339836` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:59.009133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9653434abb946af9aecef7051339836)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:46:59.016646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:46:59.426231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9653434abb946af9aecef7051339836'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:59.458653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9653434abb946af9aecef7051339836'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:59.459727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9653434abb946af9aecef7051339836'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:59.493358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9653434abb946af9aecef7051339836'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:59.514850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-33675689-b5bf-4a86-b2fc-272e9f59e45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9653434abb946af9aecef7051339836'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:46:59.529273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 922/1838] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:46:58 2022] DELETE /identity/v3/users/d9653434abb946af9aecef7051339836 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:46:59.536180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c94e2f-af11-4943-a357-0aed16cfe8b8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:59.539269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c94e2f-af11-4943-a357-0aed16cfe8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:59.541408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c94e2f-af11-4943-a357-0aed16cfe8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:59.624808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-52c94e2f-af11-4943-a357-0aed16cfe8b8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:59.626312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-52c94e2f-af11-4943-a357-0aed16cfe8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:59.740647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3203c-ee45-4980-9534-ba12f9d70f79 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:59.740939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3203c-ee45-4980-9534-ba12f9d70f79 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:59.741265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3203c-ee45-4980-9534-ba12f9d70f79 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:59.742670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 923/1839] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:46:59.766058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 917/1840] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:46:59.854838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3203c-ee45-4980-9534-ba12f9d70f79 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:46:59.856758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-def3203c-ee45-4980-9534-ba12f9d70f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:46:59.868885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:46:59.869220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:46:59.869731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:46:59.904775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:46:59.906242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:00.014254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3203c-ee45-4980-9534-ba12f9d70f79 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:00.022748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:00.023454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:00.023902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:00.024193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:00.066804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:00.068719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 918/1841] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:00.088988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:00.119653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 924/1842] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:00.618110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:00.619646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:00.648300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7475a-f8b5-4996-baf1-59bd169d1798 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:00.663787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:00.665324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:00.665745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:00.667662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] PATH_INFO: `/v3/projects/46dd75c040294046bab588ffee37e187` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:00.669134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46dd75c040294046bab588ffee37e187)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:00.675886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:00.683648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:00.780102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46dd75c040294046bab588ffee37e187', 'request_id': 'req-8b81ac3f-4a20-4a32-817e-7306a0b9d156'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:00.793490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46dd75c040294046bab588ffee37e187', 'request_id': 'req-8b81ac3f-4a20-4a32-817e-7306a0b9d156'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:00.816204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46dd75c040294046bab588ffee37e187', 'request_id': 'req-8b81ac3f-4a20-4a32-817e-7306a0b9d156'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:00.836868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] The token cache is being invalidate because project 46dd75c040294046bab588ffee37e187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:00.837004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:00.838618 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:00.842723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 919/1843] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:00 2022] DELETE /identity/v3/projects/46dd75c040294046bab588ffee37e187 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:00.847061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:00.878348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273b052-d9d9-4d0f-9503-a4264bd2c5cd service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:01.058005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:01.113235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:01.114128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:01.114417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:01.117425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] PATH_INFO: `/v3/users/6eef735e837d48d383fc581242673922` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:01.119554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eef735e837d48d383fc581242673922)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:01.137338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:01.308299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:01.310770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:01.353330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eef735e837d48d383fc581242673922'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.357098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ac3f-4a20-4a32-817e-7306a0b9d156 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:01.378464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:01.384582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:01.384915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:01.385201 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] PATH_INFO: `/v3/projects/c24f7759957148ad81ac65d1990697cc` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:01.394028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24f7759957148ad81ac65d1990697cc)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:01.399572 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:01.421901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eef735e837d48d383fc581242673922'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.425860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eef735e837d48d383fc581242673922'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.478527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eef735e837d48d383fc581242673922'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.511991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eef735e837d48d383fc581242673922'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.535810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 925/1844] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:00 2022] DELETE /identity/v3/users/6eef735e837d48d383fc581242673922 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:01.537044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:01.541851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:01.610863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24f7759957148ad81ac65d1990697cc', 'request_id': 'req-0a403837-52ac-4faa-9809-589ed88f357c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.623664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24f7759957148ad81ac65d1990697cc', 'request_id': 'req-0a403837-52ac-4faa-9809-589ed88f357c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.636184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24f7759957148ad81ac65d1990697cc', 'request_id': 'req-0a403837-52ac-4faa-9809-589ed88f357c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.654076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] The token cache is being invalidate because project c24f7759957148ad81ac65d1990697cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:01.654728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.655825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.662262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 920/1845] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:01 2022] DELETE /identity/v3/projects/c24f7759957148ad81ac65d1990697cc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:01.663894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:01.666100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:01.735543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3835f-1210-4518-b1a5-19cb6f472026 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:01.776812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a403837-52ac-4faa-9809-589ed88f357c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:01.790911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:01.793230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:01.795675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:01.796083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] PATH_INFO: `/v3/users/d94d4637fdb24897b26b797172db1b64` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:01.799617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94d4637fdb24897b26b797172db1b64)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:01.804407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:01.847099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:01.938894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94d4637fdb24897b26b797172db1b64'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.975539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:01.976546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:01.977107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94d4637fdb24897b26b797172db1b64'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:01.977589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:01.979686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:01.984933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:01.993254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94d4637fdb24897b26b797172db1b64'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:02.007595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94d4637fdb24897b26b797172db1b64'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:02.008357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94d4637fdb24897b26b797172db1b64'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:02.008967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:02.014934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:02.016997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:02.024951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 921/1846] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:01 2022] DELETE /identity/v3/users/d94d4637fdb24897b26b797172db1b64 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:02.051651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 926/1847] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:03.353475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:03.355086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:03.374533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:03.376389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:03.401702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24efb9d-475d-462c-a598-d82b030ae5bf service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:03.443990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50385ad9-a189-4b90-9e2c-4c1eb8380513 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:03.450527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:03.452564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:03.453125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:03.453837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] PATH_INFO: `/v3/projects/654149efd56f462db21684687a822071` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:03.456052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=654149efd56f462db21684687a822071)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:03.458345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:03.529493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:03.530429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:03.530780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:03.531309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] PATH_INFO: `/v3/projects/8f4f31be71194e9dbee1ca61db10bf65` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:03.532899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4f31be71194e9dbee1ca61db10bf65)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:03.534975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:03.555039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654149efd56f462db21684687a822071', 'request_id': 'req-1c013041-8c3f-4dfe-b2fe-48877a656c4a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.571992 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654149efd56f462db21684687a822071', 'request_id': 'req-1c013041-8c3f-4dfe-b2fe-48877a656c4a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.582726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654149efd56f462db21684687a822071', 'request_id': 'req-1c013041-8c3f-4dfe-b2fe-48877a656c4a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.597595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] The token cache is being invalidate because project 654149efd56f462db21684687a822071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:03.597911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.598644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.603703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 922/1848] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:03 2022] DELETE /identity/v3/projects/654149efd56f462db21684687a822071 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:03.603703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:03.603703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:03.613327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4f31be71194e9dbee1ca61db10bf65', 'request_id': 'req-eddd0130-649a-4c33-99ae-d81d8973535a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.620436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4f31be71194e9dbee1ca61db10bf65', 'request_id': 'req-eddd0130-649a-4c33-99ae-d81d8973535a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.631038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:03.632358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4f31be71194e9dbee1ca61db10bf65', 'request_id': 'req-eddd0130-649a-4c33-99ae-d81d8973535a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.671310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] The token cache is being invalidate because project 8f4f31be71194e9dbee1ca61db10bf65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:03.674712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.675692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-eddd0130-649a-4c33-99ae-d81d8973535a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.684990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 927/1849] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:03 2022] DELETE /identity/v3/projects/8f4f31be71194e9dbee1ca61db10bf65 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:03.684990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1776c-3506-4b38-88b7-945d3baf2964 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:03.684990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1776c-3506-4b38-88b7-945d3baf2964 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:03.684990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1776c-3506-4b38-88b7-945d3baf2964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:03.695637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c013041-8c3f-4dfe-b2fe-48877a656c4a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:03.764657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-73e1776c-3506-4b38-88b7-945d3baf2964 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:03.766171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-73e1776c-3506-4b38-88b7-945d3baf2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:03.804894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:03.805770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:03.806053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:03.806329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] PATH_INFO: `/v3/projects/0c4c584dbcc14b53878019361e6f6e71` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:03.809158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4c584dbcc14b53878019361e6f6e71)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:03.813962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:03.876975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 928/1850] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:03.878267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd345-01a6-47e7-b771-aab132cb0f7d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:03.878559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd345-01a6-47e7-b771-aab132cb0f7d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:03.878840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd345-01a6-47e7-b771-aab132cb0f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:03.889824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4c584dbcc14b53878019361e6f6e71', 'request_id': 'req-adab9c56-5494-45a1-a418-7ddc53c5d14c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.897096 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4c584dbcc14b53878019361e6f6e71', 'request_id': 'req-adab9c56-5494-45a1-a418-7ddc53c5d14c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.902316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-99bbd345-01a6-47e7-b771-aab132cb0f7d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:03.903589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-99bbd345-01a6-47e7-b771-aab132cb0f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:03.910933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4c584dbcc14b53878019361e6f6e71', 'request_id': 'req-adab9c56-5494-45a1-a418-7ddc53c5d14c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.922530 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] The token cache is being invalidate because project 0c4c584dbcc14b53878019361e6f6e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:03.922813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.923976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-adab9c56-5494-45a1-a418-7ddc53c5d14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:03.924864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:03.926136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 923/1851] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:03 2022] DELETE /identity/v3/projects/0c4c584dbcc14b53878019361e6f6e71 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:03.927537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9b03-6149-4645-9460-0792bec6d619 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:03.927837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9b03-6149-4645-9460-0792bec6d619 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:03.928119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9b03-6149-4645-9460-0792bec6d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:03.946962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7dbf9b03-6149-4645-9460-0792bec6d619 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:03.948198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7dbf9b03-6149-4645-9460-0792bec6d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:03.969086 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 929/1852] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:03.970520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676300-2690-450d-b021-1b010bd66729 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:03.971032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676300-2690-450d-b021-1b010bd66729 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:03.971452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676300-2690-450d-b021-1b010bd66729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:03.989924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-13676300-2690-450d-b021-1b010bd66729 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:03.991126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-13676300-2690-450d-b021-1b010bd66729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:04.000003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 930/1853] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:04.001360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c772bef-8a8e-4a71-9b30-ee9392007d16 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.001652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c772bef-8a8e-4a71-9b30-ee9392007d16 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.001933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c772bef-8a8e-4a71-9b30-ee9392007d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.010081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:04.020947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8c772bef-8a8e-4a71-9b30-ee9392007d16 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:04.022862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 924/1854] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:04.023001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8c772bef-8a8e-4a71-9b30-ee9392007d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:04.023403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13051a-5595-4e79-9ca8-2a43184bbda1 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.023590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13051a-5595-4e79-9ca8-2a43184bbda1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.024183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13051a-5595-4e79-9ca8-2a43184bbda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.038425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 931/1855] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:04.038425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c772bef-8a8e-4a71-9b30-ee9392007d16 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.042434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-de13051a-5595-4e79-9ca8-2a43184bbda1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:04.043542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-de13051a-5595-4e79-9ca8-2a43184bbda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:04.045533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c772bef-8a8e-4a71-9b30-ee9392007d16 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.050052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.050684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.050966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.051268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.051993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:04.052298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.053065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 925/1856] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:04.054006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13051a-5595-4e79-9ca8-2a43184bbda1 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.056648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.064192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13051a-5595-4e79-9ca8-2a43184bbda1 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.068993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.069657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.069959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.070231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.070964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:04.071308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.075912 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.076584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 932/1857] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:04.076584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.090591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 926/1858] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:04.091572 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.097196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123fee3-fce1-4a55-beb4-f997318f33ec admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.103588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.104268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.104552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.104960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.105713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:04.106752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.109800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.115407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43fde-2505-4424-ab6a-6c9d1bcaca73 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.123143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.123847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.124138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.125623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 933/1859] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:04.125844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.126562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.126669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.129346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.137322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81819b7d-c129-4b5d-b33d-8735850ebbf2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.142303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.142961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.143259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.143675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.144391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.147833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.179255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 934/1860] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.179255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.186226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 927/1861] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.186226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.254068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5af2cb-3ea9-4ee2-af69-69cba3e04038 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.276789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ccff-b431-4496-80ba-817ab1f45915 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.282938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.284012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.284292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.284698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.285349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.287172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.311873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 928/1862] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.316799 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.329416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.330231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.330646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.331059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a40bf-400a-4739-b36b-e76b51f0a297 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.331240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.332119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.334435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.336976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.337659 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.337943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.338424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.339492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.342092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.352581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:04.370225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 935/1863] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.370225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.370718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 929/1864] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.372365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.382759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371656-4748-4023-8dca-569dcea888f8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.442082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6204410-9d0c-4930-aa24-f8d1639fc42d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.448298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.448929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.449224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.449494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.450225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.450524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.451361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.451690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.452140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.452895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.453398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.454511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.465309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 936/1865] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:04.466799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.477559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c90d3-47ff-466d-b749-13952f6c4924 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.485926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 930/1866] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.485926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.486257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.487021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.487447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.487732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.488598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.490090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.492952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe8505-0ae3-44a1-8961-91759f15a21e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.497639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.498293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.498577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.498851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.499609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.500514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 937/1867] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:04.501186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.501290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.511109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 931/1868] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:04.511929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.513227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daab2b-4e2a-4b00-9764-c1287b710756 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.518887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.519790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.520082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.520363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.521080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.521366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d1ffa-bfec-43d2-a2db-a63b5b4f660b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.522907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.526660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.527624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.527773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.528653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.529445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.531136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.535541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 938/1869] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:04.535668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:04.535759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.547812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647b249-1bd5-4b63-8f18-15cb6ec7c78c admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.551107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 932/1870] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:04.551107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.552574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.554073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.554361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.554759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] PATH_INFO: `/v3/projects/3813062fdea944d8b53c9547bd81cafc/users/132d72477a414c10aad066c89881757c/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.560905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844055b-e148-4179-a9b7-5f114197157a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.566148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.567161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.568064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.568344 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.569251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.570838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.571009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3813062fdea944d8b53c9547bd81cafc, user_id=132d72477a414c10aad066c89881757c, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.573837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.585640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 933/1871] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:04.585640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.599929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13aa3-98f0-4ee2-8b1b-9a3a9c122a62 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.605152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 939/1872] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:04 2022] PUT /identity/v3/projects/3813062fdea944d8b53c9547bd81cafc/users/132d72477a414c10aad066c89881757c/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:04.606011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.668464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f27d62-f055-4b00-9ef9-3b83f257680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.668957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f27d62-f055-4b00-9ef9-3b83f257680c admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.669246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f27d62-f055-4b00-9ef9-3b83f257680c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.669526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f27d62-f055-4b00-9ef9-3b83f257680c admin admin] PATH_INFO: `/v3/projects/a121c61053f34cf6a8965b3adb67d8fd/users/e15d4c21894245ea92f3430416374299/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.673592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be040d-db36-4414-ad93-dbc1cdc588da admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.678789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d07f6-ffcf-427b-8609-bf62ecc4077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.679994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d07f6-ffcf-427b-8609-bf62ecc4077e admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.680315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d07f6-ffcf-427b-8609-bf62ecc4077e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.680716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d07f6-ffcf-427b-8609-bf62ecc4077e admin admin] PATH_INFO: `/v3/projects/e18a7a0014bd4f4eb7bfc1de78aa1145/users/06d46f00da2047a3bb3e605dcc0ea780/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.687125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f27d62-f055-4b00-9ef9-3b83f257680c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a121c61053f34cf6a8965b3adb67d8fd, user_id=e15d4c21894245ea92f3430416374299, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.689901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f27d62-f055-4b00-9ef9-3b83f257680c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.702821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d07f6-ffcf-427b-8609-bf62ecc4077e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18a7a0014bd4f4eb7bfc1de78aa1145, user_id=06d46f00da2047a3bb3e605dcc0ea780, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.705536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 934/1873] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:04 2022] PUT /identity/v3/projects/a121c61053f34cf6a8965b3adb67d8fd/users/e15d4c21894245ea92f3430416374299/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:04.716213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d07f6-ffcf-427b-8609-bf62ecc4077e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.716362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4848-5988-4c0c-a7b7-3632e089e596 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.716362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4848-5988-4c0c-a7b7-3632e089e596 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.716362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4848-5988-4c0c-a7b7-3632e089e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.721491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 940/1874] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:04 2022] PUT /identity/v3/projects/e18a7a0014bd4f4eb7bfc1de78aa1145/users/06d46f00da2047a3bb3e605dcc0ea780/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:04.723042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298dd5f-e265-4024-b2bf-afda2e0f1908 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.723366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298dd5f-e265-4024-b2bf-afda2e0f1908 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.723670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298dd5f-e265-4024-b2bf-afda2e0f1908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.742761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f63f4848-5988-4c0c-a7b7-3632e089e596 None None] MFA Rules not processed for user `132d72477a414c10aad066c89881757c`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:04.744164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f63f4848-5988-4c0c-a7b7-3632e089e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:04.752638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0298dd5f-e265-4024-b2bf-afda2e0f1908 None None] MFA Rules not processed for user `e15d4c21894245ea92f3430416374299`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:04.753827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0298dd5f-e265-4024-b2bf-afda2e0f1908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:04.770812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:04.812600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 935/1875] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:04.812600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937372d0-a1f4-4859-b9f7-224b98622244 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.812600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937372d0-a1f4-4859-b9f7-224b98622244 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.812600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937372d0-a1f4-4859-b9f7-224b98622244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.819928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 941/1876] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:04.821003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298dd5f-e265-4024-b2bf-afda2e0f1908 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.841687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-937372d0-a1f4-4859-b9f7-224b98622244 None None] MFA Rules not processed for user `06d46f00da2047a3bb3e605dcc0ea780`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:04.842950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-937372d0-a1f4-4859-b9f7-224b98622244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:04.896224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:04.898049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298dd5f-e265-4024-b2bf-afda2e0f1908 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.905602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.906383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.906742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.907019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.907749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.909717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.927272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 936/1877] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:04.928129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937372d0-a1f4-4859-b9f7-224b98622244 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.939728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937372d0-a1f4-4859-b9f7-224b98622244 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:04.943649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 942/1878] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.944586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:04.947721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:04.948396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:04.948687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:04.949029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:04.949662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:04.952128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:04.983949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 937/1879] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:04.984956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.024352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aacd58-2f3f-4ba0-8f8b-9d47aa7b9b52 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.051402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce25df-4838-4524-91e6-819fb98d5918 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.056491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.057164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.057453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.057728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.058539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.061029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.077936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:05.088773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 938/1880] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:05.088773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.092784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.093545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.093899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.094394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.095194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.097530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.101745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7012a-874a-4983-873d-19f4ccf151cc admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.108945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.109311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.109602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.110243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.110985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.113115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.128103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 943/1881] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:04 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:05.128103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.140832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 939/1882] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:05 2022] POST /identity/v3/users => generated 298 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:05.140832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.149303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329587-7786-4b46-8dc9-3fd6fc0bc501 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.193124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f286db-ebd5-4068-8372-5bb6439dd91d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.197734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.198390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.198701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.198976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.199747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.201906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.205851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.206518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.206809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.207088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.207797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.209738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.211648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 944/1883] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:05.212435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.222403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37304349-4888-412d-90df-8bae8e642f14 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.227054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.227870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.228161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.228443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.228985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 940/1884] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:05 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:05.229158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.230903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.231469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.240928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929bd5-36c3-4172-9f66-e8ac9ead692a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.241815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 945/1885] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:05.242804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.246468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.247592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.247877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.248157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] PATH_INFO: `/v3/projects/5ddc6c861b2f4f7292ef4a08f3086f28/users/3d8e9691e72746078291aac9258dc519/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.255000 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2ccfe-aa0c-42d7-abc6-720b89eb5202 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.261065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.261897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.262189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.262537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.263819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.264598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddc6c861b2f4f7292ef4a08f3086f28, user_id=3d8e9691e72746078291aac9258dc519, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.265367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.267272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.277982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 946/1886] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:05.278797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.283450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 941/1887] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:05 2022] PUT /identity/v3/projects/5ddc6c861b2f4f7292ef4a08f3086f28/users/3d8e9691e72746078291aac9258dc519/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:05.284493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.293009 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:05.295701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd347222-8d96-41e9-be5e-51b12d5d2b5d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.374421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c693b-02c3-4ba2-bd20-90c13ff9d7b8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.377417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.378334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.378618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.378903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] PATH_INFO: `/v3/projects/c735b29d3650465ebceec1f3c63985da/users/c89a8491aa1a4a9988a7db8e6c7557bc/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.380509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.381675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.382214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.382682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] PATH_INFO: `/v3/projects/3b6b1cb3d2144f2da1228bd68cf96128/users/fca3bd405fbe41da80d19276f071980c/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.400217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6b1cb3d2144f2da1228bd68cf96128, user_id=fca3bd405fbe41da80d19276f071980c, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.402909 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.404566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c735b29d3650465ebceec1f3c63985da, user_id=c89a8491aa1a4a9988a7db8e6c7557bc, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.407288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.423293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 947/1888] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:05 2022] PUT /identity/v3/projects/c735b29d3650465ebceec1f3c63985da/users/c89a8491aa1a4a9988a7db8e6c7557bc/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:05.424815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.440438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 942/1889] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:05 2022] PUT /identity/v3/projects/3b6b1cb3d2144f2da1228bd68cf96128/users/fca3bd405fbe41da80d19276f071980c/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:05.441258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.467231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:05.502746 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6ec8-c5b8-4611-99a8-661e51caa3ac admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.518497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba972d-fdfd-496b-9604-b4bf1aff00f1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.523459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.524118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.524402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.524678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.525400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.526990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.537038 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 943/1890] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:05.537828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.549359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a522-250d-45ca-b688-fb268f457d9b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.553904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.554560 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.554845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.555121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.555854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.557415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.558531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.559112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.560105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.560394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.561171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.562860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.568927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 944/1891] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:05.569711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.573634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 948/1892] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:05.577359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.582373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a01c1b-c771-4988-82f0-152b43d5269a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.586927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.587083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19991-9d72-40a6-9849-3fc6024f6a7e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.587854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.588134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.588412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] PATH_INFO: `/v3/projects/c735b29d3650465ebceec1f3c63985da/users/c89a8491aa1a4a9988a7db8e6c7557bc/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.590308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c735b29d3650465ebceec1f3c63985da, user_id=c89a8491aa1a4a9988a7db8e6c7557bc, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.592039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615db30a-def7-4696-acd1-b0fba5dd7695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.592929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db30a-def7-4696-acd1-b0fba5dd7695 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.593031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.593227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db30a-def7-4696-acd1-b0fba5dd7695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.593515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db30a-def7-4696-acd1-b0fba5dd7695 admin admin] PATH_INFO: `/v3/projects/3b6b1cb3d2144f2da1228bd68cf96128/users/fca3bd405fbe41da80d19276f071980c/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.595609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db30a-def7-4696-acd1-b0fba5dd7695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6b1cb3d2144f2da1228bd68cf96128, user_id=fca3bd405fbe41da80d19276f071980c, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.598369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db30a-def7-4696-acd1-b0fba5dd7695 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.604364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 945/1893] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:05 2022] PUT /identity/v3/projects/c735b29d3650465ebceec1f3c63985da/users/c89a8491aa1a4a9988a7db8e6c7557bc/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:05.605105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.616357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 949/1894] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:05 2022] PUT /identity/v3/projects/3b6b1cb3d2144f2da1228bd68cf96128/users/fca3bd405fbe41da80d19276f071980c/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:05.622616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18911e32-0e86-4d43-a830-3f8c3df7b986 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.622927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18911e32-0e86-4d43-a830-3f8c3df7b986 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.623238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18911e32-0e86-4d43-a830-3f8c3df7b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.650855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-18911e32-0e86-4d43-a830-3f8c3df7b986 None None] MFA Rules not processed for user `c89a8491aa1a4a9988a7db8e6c7557bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:05.652159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-18911e32-0e86-4d43-a830-3f8c3df7b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:05.670656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1ac9-6f60-4ca2-b9ce-88c20e9fdbdd admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.674332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:05.728626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 950/1895] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:05.729716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.729988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee4f4-4167-4b74-be3b-95b7938e7cce None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.730286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee4f4-4167-4b74-be3b-95b7938e7cce None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.730564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee4f4-4167-4b74-be3b-95b7938e7cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.730730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.730985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.731958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] PATH_INFO: `/v3/projects/5ddc6c861b2f4f7292ef4a08f3086f28/users/3d8e9691e72746078291aac9258dc519/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.734542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddc6c861b2f4f7292ef4a08f3086f28, user_id=3d8e9691e72746078291aac9258dc519, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.739871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.754269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 946/1896] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:05 2022] PUT /identity/v3/projects/5ddc6c861b2f4f7292ef4a08f3086f28/users/3d8e9691e72746078291aac9258dc519/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:05.755125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.760568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9e7ee4f4-4167-4b74-be3b-95b7938e7cce None None] MFA Rules not processed for user `fca3bd405fbe41da80d19276f071980c`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:05.762080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9e7ee4f4-4167-4b74-be3b-95b7938e7cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:05.764929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:05.808534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:05.837764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8522ad-91b2-453e-9890-65af41bd0317 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.844450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.845486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.845791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.846138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.848919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 951/1897] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:05.850307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eec0b-8ea5-4b12-8d1a-bffe01719960 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.850598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eec0b-8ea5-4b12-8d1a-bffe01719960 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.850876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eec0b-8ea5-4b12-8d1a-bffe01719960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.894773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-667eec0b-8ea5-4b12-8d1a-bffe01719960 None None] MFA Rules not processed for user `3d8e9691e72746078291aac9258dc519`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:05.896145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-667eec0b-8ea5-4b12-8d1a-bffe01719960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:05.937467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.939775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.950972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 947/1898] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:05.951705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:05.953432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:05.968190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ba2ea-3a3a-413b-8e59-866b4597b3b3 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:05.972775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:05.973607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:05.974399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:05.974777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:05.987577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:05.989593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:05.997135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 952/1899] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:06.004777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 948/1900] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:06.051579 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eec0b-8ea5-4b12-8d1a-bffe01719960 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:06.064464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eec0b-8ea5-4b12-8d1a-bffe01719960 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:06.070264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4aa50-2580-4004-bdcd-957c3f25bc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:06.071026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4aa50-2580-4004-bdcd-957c3f25bc7c service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:06.071421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4aa50-2580-4004-bdcd-957c3f25bc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:06.071708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4aa50-2580-4004-bdcd-957c3f25bc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:06.173246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4aa50-2580-4004-bdcd-957c3f25bc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:06.175452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4aa50-2580-4004-bdcd-957c3f25bc7c service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:06.204155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 953/1901] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:06.836948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:06.908511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:06.928272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148886-7a06-4f4a-9b8a-c95272310008 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:06.932753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:06.933614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:06.933899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:06.934177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] PATH_INFO: `/v3/users/06d46f00da2047a3bb3e605dcc0ea780` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:06.935513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d46f00da2047a3bb3e605dcc0ea780)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:06.937457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:06.985343 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d46f00da2047a3bb3e605dcc0ea780'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:06.997665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d46f00da2047a3bb3e605dcc0ea780'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.005433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d46f00da2047a3bb3e605dcc0ea780'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.013734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d46f00da2047a3bb3e605dcc0ea780'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.014389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d46f00da2047a3bb3e605dcc0ea780'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.020615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 949/1902] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:06 2022] DELETE /identity/v3/users/06d46f00da2047a3bb3e605dcc0ea780 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:07.025654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:07.026211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:07.026291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:07.043600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:07.045413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:07.100227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:07.111949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 954/1903] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:07.122395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:07.123921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:07.180537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b51f3-14ca-4c9f-8923-e750d3d04383 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:07.184305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:07.185569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:07.185853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:07.186129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:07.200956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:07.202602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:07.223301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 950/1904] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:07.771583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:07.773793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:07.798271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98e796-fc15-40c8-989f-701f7c6e3da0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:07.812607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:07.813747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:07.814040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:07.814316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] PATH_INFO: `/v3/projects/e18a7a0014bd4f4eb7bfc1de78aa1145` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:07.815587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18a7a0014bd4f4eb7bfc1de78aa1145)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:07.819233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:07.954671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18a7a0014bd4f4eb7bfc1de78aa1145', 'request_id': 'req-98c1e08d-66f7-4771-b031-8c46bb153fb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.962543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18a7a0014bd4f4eb7bfc1de78aa1145', 'request_id': 'req-98c1e08d-66f7-4771-b031-8c46bb153fb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.972909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18a7a0014bd4f4eb7bfc1de78aa1145', 'request_id': 'req-98c1e08d-66f7-4771-b031-8c46bb153fb7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.988509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] The token cache is being invalidate because project e18a7a0014bd4f4eb7bfc1de78aa1145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:07.988811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.989554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:07.997247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 955/1905] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:07 2022] DELETE /identity/v3/projects/e18a7a0014bd4f4eb7bfc1de78aa1145 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:07.998438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:08.020855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442befb-9549-48f5-8b63-e3c817763efd service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:08.157150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:08.164464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:08.166088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:08.166481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] PATH_INFO: `/v3/users/fca3bd405fbe41da80d19276f071980c` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:08.171902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca3bd405fbe41da80d19276f071980c)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:08.178537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:08.199636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:08.307466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca3bd405fbe41da80d19276f071980c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:08.327636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca3bd405fbe41da80d19276f071980c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:08.339342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca3bd405fbe41da80d19276f071980c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:08.350167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca3bd405fbe41da80d19276f071980c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:08.350906 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca3bd405fbe41da80d19276f071980c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:08.358682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 951/1906] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:07 2022] DELETE /identity/v3/users/fca3bd405fbe41da80d19276f071980c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:09.141259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:09.143573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:09.161918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e08d-66f7-4771-b031-8c46bb153fb7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:09.191933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:09.193430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:09.296424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:09.297306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.297594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.297879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] PATH_INFO: `/v3/projects/3b6b1cb3d2144f2da1228bd68cf96128` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.299245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6b1cb3d2144f2da1228bd68cf96128)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:09.301332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:09.307141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443535-5376-429c-b8fd-9807cf244368 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:09.312204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:09.314185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.314766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.315116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] PATH_INFO: `/v3/users/132d72477a414c10aad066c89881757c` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.317325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132d72477a414c10aad066c89881757c)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:09.319368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:09.377062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6b1cb3d2144f2da1228bd68cf96128', 'request_id': 'req-6e185d3a-48f5-4275-8cdf-4531c1d407d8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.385317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6b1cb3d2144f2da1228bd68cf96128', 'request_id': 'req-6e185d3a-48f5-4275-8cdf-4531c1d407d8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.397874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6b1cb3d2144f2da1228bd68cf96128', 'request_id': 'req-6e185d3a-48f5-4275-8cdf-4531c1d407d8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.403318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132d72477a414c10aad066c89881757c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.417077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] The token cache is being invalidate because project 3b6b1cb3d2144f2da1228bd68cf96128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:09.417338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.418115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6e185d3a-48f5-4275-8cdf-4531c1d407d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.421259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 956/1907] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:09 2022] DELETE /identity/v3/projects/3b6b1cb3d2144f2da1228bd68cf96128 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:09.425488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b24dc-b852-481a-8e2a-fa22dc469637 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.425780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b24dc-b852-481a-8e2a-fa22dc469637 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.426140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b24dc-b852-481a-8e2a-fa22dc469637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.429855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132d72477a414c10aad066c89881757c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.441478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132d72477a414c10aad066c89881757c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.449232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132d72477a414c10aad066c89881757c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.449922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2efd1581-0581-4c78-992a-61bcc22ace70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132d72477a414c10aad066c89881757c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:09.451081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-939b24dc-b852-481a-8e2a-fa22dc469637 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:09.452346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-939b24dc-b852-481a-8e2a-fa22dc469637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:09.456712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 952/1908] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:09 2022] DELETE /identity/v3/users/132d72477a414c10aad066c89881757c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:09.460913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.461458 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.461838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.463380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:09.470146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:09.491187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:09.494209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:09.561283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 957/1909] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:09.570475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332046-b563-4499-938f-396f1face7f0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.570767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332046-b563-4499-938f-396f1face7f0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.571048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332046-b563-4499-938f-396f1face7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.593055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0c332046-b563-4499-938f-396f1face7f0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:09.594631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0c332046-b563-4499-938f-396f1face7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:09.611359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 953/1910] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:09.621537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:09.623726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:09.714533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 958/1911] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:09.718691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332046-b563-4499-938f-396f1face7f0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:09.734152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332046-b563-4499-938f-396f1face7f0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:09.741505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:09.742483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.742804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.743346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.744069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:09.744389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:09.746316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:09.748537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52906-648d-46e9-bff1-7847049bb013 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:09.752788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:09.753817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.754482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.754830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.764241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 959/1912] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:47:09.768690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:09.775699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:09.779995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:09.786462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b31aa-d8b5-4381-a5ba-d81665172831 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:09.796382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:09.798021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.798475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.799607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.801370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:09.805690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:09.808949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 954/1913] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:09.871260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 960/1914] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:09 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:09.874796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:09.889895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e22a0-7bbb-4a9b-a23a-24eb2d8be5af service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:09.964764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:09.965503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:09.966319 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:09.966600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:09.967340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:09.969377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:10.021260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 955/1915] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:09 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:10.026002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:10.042295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971dd8-6db7-4e11-8e6b-222ba1f1cba8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:10.055801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:10.056930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.057406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.057911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.059036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:10.060926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:10.078881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 961/1916] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:10.082535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:10.096045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd6cd-1adb-4347-b4d8-315400230331 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:10.109041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53138e-3f54-4db5-a3a0-399164efa30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:10.109863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53138e-3f54-4db5-a3a0-399164efa30d admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.110213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53138e-3f54-4db5-a3a0-399164efa30d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.110533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53138e-3f54-4db5-a3a0-399164efa30d admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.111360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53138e-3f54-4db5-a3a0-399164efa30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:10.113062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53138e-3f54-4db5-a3a0-399164efa30d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:10.127541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 956/1917] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:10.131524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:10.146627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96a06-94d9-4305-ba3e-411604ec03e3 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:10.156935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:10.157850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.158139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.158599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] PATH_INFO: `/v3/projects/2d8dee04a38b47b78eb8d4a6f29bd598/users/cd9cf13860494875b8122b5a664b813a/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.176837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8dee04a38b47b78eb8d4a6f29bd598, user_id=cd9cf13860494875b8122b5a664b813a, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:10.179621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:10.198481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 962/1918] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:10 2022] PUT /identity/v3/projects/2d8dee04a38b47b78eb8d4a6f29bd598/users/cd9cf13860494875b8122b5a664b813a/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:10.210416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.210913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.211016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.224514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:10.226565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:10.252871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] MFA Rules not processed for user `cd9cf13860494875b8122b5a664b813a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:10.255468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:10.273147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:10.315856 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:10.351784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f62aaa-389b-4e0b-835d-2e0aaf5c6044 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:10.358448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:10.359466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.359752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.360021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] PATH_INFO: `/v3/projects/3813062fdea944d8b53c9547bd81cafc` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.361596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3813062fdea944d8b53c9547bd81cafc)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:10.364617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:10.383263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 957/1919] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:10.397847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:10.399381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:10.456518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3813062fdea944d8b53c9547bd81cafc', 'request_id': 'req-9e7bd615-8cb0-4864-a392-274cc0e834d4'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.469893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3813062fdea944d8b53c9547bd81cafc', 'request_id': 'req-9e7bd615-8cb0-4864-a392-274cc0e834d4'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.485805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3813062fdea944d8b53c9547bd81cafc', 'request_id': 'req-9e7bd615-8cb0-4864-a392-274cc0e834d4'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.508797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] The token cache is being invalidate because project 3813062fdea944d8b53c9547bd81cafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:10.510879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.521431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba0ec-165a-4759-99fa-5ac4805fff49 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:10.522485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.527738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 963/1920] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:10 2022] DELETE /identity/v3/projects/3813062fdea944d8b53c9547bd81cafc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:10.535528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:10.544797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:10.628148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdfb8-fddb-4d2f-a560-9f01cf3bb08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:10.628822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdfb8-fddb-4d2f-a560-9f01cf3bb08e service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.629115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdfb8-fddb-4d2f-a560-9f01cf3bb08e service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.629398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdfb8-fddb-4d2f-a560-9f01cf3bb08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.634626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b07bdfb8-fddb-4d2f-a560-9f01cf3bb08e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:10.680457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bd615-8cb0-4864-a392-274cc0e834d4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:10.688104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:10.689442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.689879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.690304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] PATH_INFO: `/v3/users/3d8e9691e72746078291aac9258dc519` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.692679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8e9691e72746078291aac9258dc519)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:10.695453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:10.729457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bdfb8-fddb-4d2f-a560-9f01cf3bb08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:10.731192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bdfb8-fddb-4d2f-a560-9f01cf3bb08e service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:10.742931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 958/1921] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:10.746478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323ea6-1d92-43f5-8727-98a73bc3e127 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.747048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323ea6-1d92-43f5-8727-98a73bc3e127 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.747740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323ea6-1d92-43f5-8727-98a73bc3e127 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.749776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 959/1922] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:47:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:47:10.761270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:10.761985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:10.763021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:10.780309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8e9691e72746078291aac9258dc519'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.791459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:10.793873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:10.796467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8e9691e72746078291aac9258dc519'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.797729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8e9691e72746078291aac9258dc519'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.808327 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8e9691e72746078291aac9258dc519'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.812239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:10.822378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8e9691e72746078291aac9258dc519'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:10.831042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:10.838171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 964/1923] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:10 2022] DELETE /identity/v3/users/3d8e9691e72746078291aac9258dc519 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:10.924953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 960/1924] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:10.942867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:10.944077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:11.161481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfd30-88ec-47a7-9b9e-9ce17c286023 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:11.172176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:11.172701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:11.172996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:11.173278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:11.189547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:11.192331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:11.226192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 965/1925] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:11.231892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:11.234200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:11.264766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f137aad-df88-468e-bef1-8fa7dc527295 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:11.375720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57fca9-fc5b-48ce-90ed-e30af2f3789a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:11.377308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57fca9-fc5b-48ce-90ed-e30af2f3789a service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:11.377711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57fca9-fc5b-48ce-90ed-e30af2f3789a service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:11.378068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57fca9-fc5b-48ce-90ed-e30af2f3789a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:11.380640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-bc57fca9-fc5b-48ce-90ed-e30af2f3789a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:11.488863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:11.490292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:11.538461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57fca9-fc5b-48ce-90ed-e30af2f3789a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:11.540093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57fca9-fc5b-48ce-90ed-e30af2f3789a service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:11.582430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 961/1926] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:11.647589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a3d18-b5d4-4190-a8ce-a85bf1c17048 service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:11.653071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:11.654904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:11.655232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:11.655553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] PATH_INFO: `/v3/projects/5ddc6c861b2f4f7292ef4a08f3086f28` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:11.656973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ddc6c861b2f4f7292ef4a08f3086f28)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:11.659577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:11.775551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ddc6c861b2f4f7292ef4a08f3086f28', 'request_id': 'req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:11.789901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ddc6c861b2f4f7292ef4a08f3086f28', 'request_id': 'req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:11.814522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ddc6c861b2f4f7292ef4a08f3086f28', 'request_id': 'req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:11.828361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] The token cache is being invalidate because project 5ddc6c861b2f4f7292ef4a08f3086f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:11.828604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:11.829360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-abf8ef94-08c6-4baa-a11a-559bec9c4ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:11.831272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 966/1927] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:11 2022] DELETE /identity/v3/projects/5ddc6c861b2f4f7292ef4a08f3086f28 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:11.836271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8107dd7-a9e5-4888-9a76-32abeda0d2ca None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:11.836803 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8107dd7-a9e5-4888-9a76-32abeda0d2ca None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:11.837903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8107dd7-a9e5-4888-9a76-32abeda0d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:11.869390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b8107dd7-a9e5-4888-9a76-32abeda0d2ca None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:11.870696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b8107dd7-a9e5-4888-9a76-32abeda0d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:11.997546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 962/1928] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:12.006072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938da5a-fab7-40f1-b242-8a295bc72546 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.006566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938da5a-fab7-40f1-b242-8a295bc72546 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.007519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938da5a-fab7-40f1-b242-8a295bc72546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.027038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:12.060211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1938da5a-fab7-40f1-b242-8a295bc72546 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:12.065303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1938da5a-fab7-40f1-b242-8a295bc72546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:12.094989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 967/1929] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:12.096191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8107dd7-a9e5-4888-9a76-32abeda0d2ca None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:12.123149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8107dd7-a9e5-4888-9a76-32abeda0d2ca None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:12.130555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:12.139782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.139782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.139782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.139782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:12.139782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:12.139782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:12.140365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:12.163254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 963/1930] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:12.166656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938da5a-fab7-40f1-b242-8a295bc72546 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:12.187324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938da5a-fab7-40f1-b242-8a295bc72546 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:12.200799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:12.201488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.201776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.202057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.202759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:12.204726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:12.279750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 968/1931] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:12 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:12.281384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:12.301218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd33f0e-b5d6-4557-ba8b-15d256a08243 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:12.395786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:12.396480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.396771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.397306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.397998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:12.401978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:12.425810 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 964/1932] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:12 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:12.430453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:12.442152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225fc3e-f31d-4479-af67-50b3596d87a9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:12.451290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:12.452061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.452439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.452881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.453615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:12.456895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:12.470924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 969/1933] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:12.474781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:12.486350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047611f-db4e-4ad0-91fd-f5ee6818b9ca admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:12.491262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43fcd7-5e0d-4b01-9a4f-4df2c968fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:12.492014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43fcd7-5e0d-4b01-9a4f-4df2c968fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.492372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43fcd7-5e0d-4b01-9a4f-4df2c968fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.492722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43fcd7-5e0d-4b01-9a4f-4df2c968fae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.493522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43fcd7-5e0d-4b01-9a4f-4df2c968fae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:12.495348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43fcd7-5e0d-4b01-9a4f-4df2c968fae4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:12.508998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 965/1934] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:12.519829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:12.535635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2048a8f-672d-4a81-9187-28c8a414cf0c admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:12.542711 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:12.544264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.544581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.544879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] PATH_INFO: `/v3/projects/8705f6b6c3434e42976560fd1087ae3b/users/156969e91c2041d39ce5a779684e43d9/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.564183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8705f6b6c3434e42976560fd1087ae3b, user_id=156969e91c2041d39ce5a779684e43d9, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:12.566829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:12.583757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 970/1935] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:12 2022] PUT /identity/v3/projects/8705f6b6c3434e42976560fd1087ae3b/users/156969e91c2041d39ce5a779684e43d9/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:12.594522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.594820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.595103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.626924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] MFA Rules not processed for user `156969e91c2041d39ce5a779684e43d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:12.628332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:12.693444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 966/1936] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:12.706126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:12.707872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:12.767562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58646f35-29b9-4bb7-b3b9-2a91ef48546a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:12.771278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0d5f4-641a-43d6-ae77-47e125937222 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:12.772176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0d5f4-641a-43d6-ae77-47e125937222 service glance] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:12.772471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0d5f4-641a-43d6-ae77-47e125937222 service glance] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:12.772753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0d5f4-641a-43d6-ae77-47e125937222 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:12.781194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0d5f4-641a-43d6-ae77-47e125937222 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:12.782813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0d5f4-641a-43d6-ae77-47e125937222 service glance] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:12.792510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 971/1937] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:14.578324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:14.579811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:14.713866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52d400-0058-4cb4-8ba0-1f8f72baafe8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:14.719695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:14.720529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:14.720816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:14.721091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] PATH_INFO: `/v3/users/cd9cf13860494875b8122b5a664b813a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:14.727646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9cf13860494875b8122b5a664b813a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:14.730123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:14.734305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:14.793412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9cf13860494875b8122b5a664b813a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:14.809989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9cf13860494875b8122b5a664b813a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:14.819721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9cf13860494875b8122b5a664b813a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:14.827538 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9cf13860494875b8122b5a664b813a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:14.830234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9cf13860494875b8122b5a664b813a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:14.836939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 967/1938] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:14 2022] DELETE /identity/v3/users/cd9cf13860494875b8122b5a664b813a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:14.856706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:14.857238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:14.857465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:14.880759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:14.882227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:14.963170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 972/1939] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:14.975191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:14.977321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:15.072895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc8801-fe05-4b58-bf2a-83928f3da300 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:15.077732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f50e-7ad9-4d12-a65d-cdff28496cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:15.078334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f50e-7ad9-4d12-a65d-cdff28496cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.078620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f50e-7ad9-4d12-a65d-cdff28496cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.078897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f50e-7ad9-4d12-a65d-cdff28496cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.088527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f50e-7ad9-4d12-a65d-cdff28496cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:15.089971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f50e-7ad9-4d12-a65d-cdff28496cd6 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:15.100651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 968/1940] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:15.433005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:15.435408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:15.452031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a62215-2847-4cd5-8ccb-4d0d2b21a5a1 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:15.458462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:15.459492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.459839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.460181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] PATH_INFO: `/v3/projects/2d8dee04a38b47b78eb8d4a6f29bd598` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.464460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8dee04a38b47b78eb8d4a6f29bd598)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:15.467060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:15.525436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:15.533213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8dee04a38b47b78eb8d4a6f29bd598', 'request_id': 'req-c6130a09-709d-4960-8150-d7fea42434b8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:15.539641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8dee04a38b47b78eb8d4a6f29bd598', 'request_id': 'req-c6130a09-709d-4960-8150-d7fea42434b8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:15.547980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8dee04a38b47b78eb8d4a6f29bd598', 'request_id': 'req-c6130a09-709d-4960-8150-d7fea42434b8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:15.560414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] The token cache is being invalidate because project 2d8dee04a38b47b78eb8d4a6f29bd598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:15.560716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:15.561392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c6130a09-709d-4960-8150-d7fea42434b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:15.563072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 973/1941] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:15 2022] DELETE /identity/v3/projects/2d8dee04a38b47b78eb8d4a6f29bd598 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:15.568205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f534a-5d34-48c9-a64d-4ee62240f724 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.568504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f534a-5d34-48c9-a64d-4ee62240f724 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.568826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f534a-5d34-48c9-a64d-4ee62240f724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.587668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c41f534a-5d34-48c9-a64d-4ee62240f724 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:15.588956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c41f534a-5d34-48c9-a64d-4ee62240f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:15.658373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 969/1942] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:15.666024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042f56d-e36f-43b9-998e-7c4af093ea56 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.667239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042f56d-e36f-43b9-998e-7c4af093ea56 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.667239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042f56d-e36f-43b9-998e-7c4af093ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.686838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1042f56d-e36f-43b9-998e-7c4af093ea56 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:15.688175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1042f56d-e36f-43b9-998e-7c4af093ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:15.696305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 974/1943] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:15.700884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f534a-5d34-48c9-a64d-4ee62240f724 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:15.711390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f534a-5d34-48c9-a64d-4ee62240f724 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:15.716688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:15.717438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.717799 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.718142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.718937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:15.719362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:15.721090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:15.746314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 970/1944] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:15.747695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042f56d-e36f-43b9-998e-7c4af093ea56 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:15.757020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042f56d-e36f-43b9-998e-7c4af093ea56 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:15.762247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:15.763033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.763942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.763942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.764673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:15.766859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:15.806920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 975/1945] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:15 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:15.808281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:15.820359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921231-007f-479b-8fc3-65c15df2367c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:15.830514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:15.914502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:15.915304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.915596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.915879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.916570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:15.918493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:15.941320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 971/1946] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:15 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:15.942490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:15.953597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b444-4f62-4a99-b325-f86ed39db184 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:15.961702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:15.962337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:15.962730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:15.962904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:15.963776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:15.966206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:15.979181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 976/1947] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:15.983082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:15.995954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b911ef-5cce-4d8a-924a-88436b15e847 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:16.009393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa6a90-4a3e-4d4c-95ac-c22c463f540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:16.009393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa6a90-4a3e-4d4c-95ac-c22c463f540b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:16.009393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa6a90-4a3e-4d4c-95ac-c22c463f540b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:16.009393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa6a90-4a3e-4d4c-95ac-c22c463f540b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:16.009877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa6a90-4a3e-4d4c-95ac-c22c463f540b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:16.011481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa6a90-4a3e-4d4c-95ac-c22c463f540b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:16.026790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 972/1948] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:16.031006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:16.042545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286dee-f1d2-4886-a10f-1ed7438299b9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:16.058983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:16.060191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:16.060398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:16.060686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] PATH_INFO: `/v3/projects/f8296259ba704d898035048559e0b3b8/users/3299d3b5a5f14c588ef6e9fb7246b43a/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:16.083047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8296259ba704d898035048559e0b3b8, user_id=3299d3b5a5f14c588ef6e9fb7246b43a, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:16.086089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:16.107505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 977/1949] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:16 2022] PUT /identity/v3/projects/f8296259ba704d898035048559e0b3b8/users/3299d3b5a5f14c588ef6e9fb7246b43a/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:16.112430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a0762-a827-44e2-8db7-88d3f16af975 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:16.112725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a0762-a827-44e2-8db7-88d3f16af975 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:16.113010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a0762-a827-44e2-8db7-88d3f16af975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:16.134072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c11a0762-a827-44e2-8db7-88d3f16af975 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:16.135331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c11a0762-a827-44e2-8db7-88d3f16af975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:16.231474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 973/1950] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:16.240337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:16.242357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:16.335814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26383b-cca4-4218-b47b-c4e46b8cca61 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:16.342588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:16.343582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:16.344059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:16.344513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:16.367266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:16.368718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:16.379883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 978/1951] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:17.413320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:17.413762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:17.413855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:17.417022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:17.420056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:17.446503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621358c4-3f80-4fa6-9cbe-8c8d7b1d719f service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:17.459601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:17.460492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:17.460782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:17.461065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] PATH_INFO: `/v3/users/e15d4c21894245ea92f3430416374299` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:17.463619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15d4c21894245ea92f3430416374299)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:17.465628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:17.470752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] MFA Rules not processed for user `3299d3b5a5f14c588ef6e9fb7246b43a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:17.472328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:17.592729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15d4c21894245ea92f3430416374299'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:17.610362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15d4c21894245ea92f3430416374299'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:17.611199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:17.612146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15d4c21894245ea92f3430416374299'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:17.621713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 974/1952] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:17.625832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15d4c21894245ea92f3430416374299'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:17.646232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ac889044-a79b-49a4-b828-195c4202bbf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15d4c21894245ea92f3430416374299'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:17.647403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:17.653954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:17.660340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 979/1953] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:17 2022] DELETE /identity/v3/users/e15d4c21894245ea92f3430416374299 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:17.666901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:17.667864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:17.669090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:17.684974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:17.735907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:17.743609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:17.748966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68114-001a-4cc2-a812-dd7203939f5b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:17.918293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:17.933507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:17.933906 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:17.936520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 980/1954] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:17.954248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:17.957091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:17.961380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:17.966265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:18.089938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:18.094465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:18.119546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 975/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:18.185718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a917a-4c72-4aa3-91e9-0a30f5907035 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:18.196161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:18.208090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:18.208588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:18.210964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:18.250162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:18.255967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:18.290884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 981/1956] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:19.061182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:19.062640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:19.077205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7bd40-d203-4781-a5a7-d1d9bb4b6d23 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:19.084313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:19.084313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:19.084313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:19.084313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] PATH_INFO: `/v3/projects/a121c61053f34cf6a8965b3adb67d8fd` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:19.085581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a121c61053f34cf6a8965b3adb67d8fd)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:19.087654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:19.147760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a121c61053f34cf6a8965b3adb67d8fd', 'request_id': 'req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.154536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a121c61053f34cf6a8965b3adb67d8fd', 'request_id': 'req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.161736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a121c61053f34cf6a8965b3adb67d8fd', 'request_id': 'req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.172706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] The token cache is being invalidate because project a121c61053f34cf6a8965b3adb67d8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:19.172997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.173663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.175229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 976/1957] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:19 2022] DELETE /identity/v3/projects/a121c61053f34cf6a8965b3adb67d8fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:19.179099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:19.189014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ad594-1f41-4be5-ad23-ee638d0adcf2 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:19.257593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:19.258488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:19.258786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:19.259112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] PATH_INFO: `/v3/users/c89a8491aa1a4a9988a7db8e6c7557bc` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:19.260357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89a8491aa1a4a9988a7db8e6c7557bc)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:19.263026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:19.335822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:19.389558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89a8491aa1a4a9988a7db8e6c7557bc'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.407971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89a8491aa1a4a9988a7db8e6c7557bc'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.409085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89a8491aa1a4a9988a7db8e6c7557bc'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.419526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89a8491aa1a4a9988a7db8e6c7557bc'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.431708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89a8491aa1a4a9988a7db8e6c7557bc'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.446335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 982/1958] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:19 2022] DELETE /identity/v3/users/c89a8491aa1a4a9988a7db8e6c7557bc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:19.721117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:19.722620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:19.736414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd9751-b9ad-4ccc-b83e-ad58427dd8e0 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:19.750740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:19.763890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:19.765341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:19.820145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:19.821029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:19.821317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:19.821604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] PATH_INFO: `/v3/users/23ce08cc101e4b6289be60b85af77abe` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:19.823474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ce08cc101e4b6289be60b85af77abe)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:19.825454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:19.849823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c552-e15f-44de-a3fc-94352ad9aef9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:19.857614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:19.858967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:19.859358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:19.859715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] PATH_INFO: `/v3/projects/c735b29d3650465ebceec1f3c63985da` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:19.861131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c735b29d3650465ebceec1f3c63985da)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:19.863982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:19.880695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ce08cc101e4b6289be60b85af77abe'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.903771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ce08cc101e4b6289be60b85af77abe'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.933869 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ce08cc101e4b6289be60b85af77abe'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.951933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c735b29d3650465ebceec1f3c63985da', 'request_id': 'req-dd0affd3-efb2-42a3-99f4-270dfd4d8735'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.965017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ce08cc101e4b6289be60b85af77abe'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.965017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c6d27f29-4348-40c5-acf7-de5043ec1696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ce08cc101e4b6289be60b85af77abe'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.969876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 977/1959] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:19 2022] DELETE /identity/v3/users/23ce08cc101e4b6289be60b85af77abe => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:19.971939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c735b29d3650465ebceec1f3c63985da', 'request_id': 'req-dd0affd3-efb2-42a3-99f4-270dfd4d8735'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.972486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57247a-5190-49bf-b786-bf964723a65c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:19.972779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57247a-5190-49bf-b786-bf964723a65c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:19.973091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57247a-5190-49bf-b786-bf964723a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:19.981445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c735b29d3650465ebceec1f3c63985da', 'request_id': 'req-dd0affd3-efb2-42a3-99f4-270dfd4d8735'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.995672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] The token cache is being invalidate because project c735b29d3650465ebceec1f3c63985da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:19.996608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.997518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dd0affd3-efb2-42a3-99f4-270dfd4d8735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:19.999979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 983/1960] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:19 2022] DELETE /identity/v3/projects/c735b29d3650465ebceec1f3c63985da => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:20.001757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.002115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.002394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.011369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8e57247a-5190-49bf-b786-bf964723a65c None None] MFA Rules not processed for user `3299d3b5a5f14c588ef6e9fb7246b43a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:20.013004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8e57247a-5190-49bf-b786-bf964723a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.032863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:20.034185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.068863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:20.112384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 978/1961] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:20.113695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505afb-cbf8-4c54-a5f5-5a9e8ea64725 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.114092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505afb-cbf8-4c54-a5f5-5a9e8ea64725 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.114483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505afb-cbf8-4c54-a5f5-5a9e8ea64725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.137616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 984/1962] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:20.139912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.142416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.161362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8d505afb-cbf8-4c54-a5f5-5a9e8ea64725 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:20.168943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8d505afb-cbf8-4c54-a5f5-5a9e8ea64725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.199068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 979/1963] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:20.201349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba496e-33be-4667-b4e5-21d640f84dfc None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.201780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba496e-33be-4667-b4e5-21d640f84dfc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.202132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba496e-33be-4667-b4e5-21d640f84dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.225914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-bbba496e-33be-4667-b4e5-21d640f84dfc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:20.227675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-bbba496e-33be-4667-b4e5-21d640f84dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.239067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 980/1964] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:20.243384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba496e-33be-4667-b4e5-21d640f84dfc None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.261245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba496e-33be-4667-b4e5-21d640f84dfc None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.266837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.267549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.267841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.268132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.268864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:20.269177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.270797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.284751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488c2b-9281-4db5-a65e-393bfd67141b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.286166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 981/1965] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:20.290469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.290901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.291548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.291845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.292159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.304771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.305834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01fe26-bb33-4d63-b122-ebeb66c8dda1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.306543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.310589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.311433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.311722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.312061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.312753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.315107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.319866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 985/1966] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:20.324520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:20.345089 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 982/1967] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:20 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:20.350282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.365418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1b745-a3a1-42a2-ab3d-27fb18efce74 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.454573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.457388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.458411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.458757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.459961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.463619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.501691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 986/1968] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:20 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:20.506193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.520073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958064d-8aa5-46bd-a2aa-46909f5c44ed admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.543092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.543092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.543092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.543092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.544295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.546509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.559621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 983/1969] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:20.563296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.573823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e54ecc-2c09-4c02-975b-8cad19d28c60 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.578776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344ee44-747d-4a83-ae4c-61af171d040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.579519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ee44-747d-4a83-ae4c-61af171d040d admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.579802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ee44-747d-4a83-ae4c-61af171d040d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.580084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ee44-747d-4a83-ae4c-61af171d040d admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.580938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344ee44-747d-4a83-ae4c-61af171d040d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.582723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344ee44-747d-4a83-ae4c-61af171d040d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.593752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 987/1970] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:20.598063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.610205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91ab5-2fa5-4b9f-9675-708d1fd2b17e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.615473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.616944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.617239 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.617526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] PATH_INFO: `/v3/projects/5d18c013abe04dc5817684d5b4447716/users/ec6d8af9f84e4743a3f7b8803c8eaeb9/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.634951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d18c013abe04dc5817684d5b4447716, user_id=ec6d8af9f84e4743a3f7b8803c8eaeb9, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.637769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.671292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 984/1971] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:20 2022] PUT /identity/v3/projects/5d18c013abe04dc5817684d5b4447716/users/ec6d8af9f84e4743a3f7b8803c8eaeb9/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:20.681510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.681891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.682187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.709270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.711787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.714542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] MFA Rules not processed for user `ec6d8af9f84e4743a3f7b8803c8eaeb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:20.716284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.775002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:20.807249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397fe3-172b-4690-b873-809136474c2c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.813875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:20.815078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:20.815191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:20.815455 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] PATH_INFO: `/v3/projects/0ab2cbee30824308ae9146dc8833f420` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:20.816121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 988/1972] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:20.816922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab2cbee30824308ae9146dc8833f420)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:20.819137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:20.831300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.833226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:20.885103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab2cbee30824308ae9146dc8833f420', 'request_id': 'req-40dd8565-3636-4995-ba58-865b761994df'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:20.893587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab2cbee30824308ae9146dc8833f420', 'request_id': 'req-40dd8565-3636-4995-ba58-865b761994df'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:20.900729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab2cbee30824308ae9146dc8833f420', 'request_id': 'req-40dd8565-3636-4995-ba58-865b761994df'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:20.907185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a0aa2-8678-4ce9-ad16-405a8ba9cedc None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:20.922174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] The token cache is being invalidate because project 0ab2cbee30824308ae9146dc8833f420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:20.922634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:20.924652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:20.926950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 985/1973] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:20 2022] DELETE /identity/v3/projects/0ab2cbee30824308ae9146dc8833f420 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:20.931317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:20.934601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:21.001793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:21.002641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:21.002935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:21.006568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:21.010762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:21.063219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:21.086326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8565-3636-4995-ba58-865b761994df admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:21.092998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:21.094252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:21.094554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:21.094868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] PATH_INFO: `/v3/users/dd5dba30cacd431e8412a0af7de53a92` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:21.096294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5dba30cacd431e8412a0af7de53a92)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:21.099084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:21.100645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:21.102098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:21.118774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 989/1974] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:21.160582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5dba30cacd431e8412a0af7de53a92'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.177485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5dba30cacd431e8412a0af7de53a92'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.191024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5dba30cacd431e8412a0af7de53a92'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.210203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5dba30cacd431e8412a0af7de53a92'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.213108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-08429ac6-0161-43ff-a07d-0d086af418a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5dba30cacd431e8412a0af7de53a92'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.221597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 986/1975] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:20 2022] DELETE /identity/v3/users/dd5dba30cacd431e8412a0af7de53a92 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:21.663007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:21.692929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1bf1a-b5b6-4783-b203-b5780276c7d3 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:21.784462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:21.801075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:21.802568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:21.803083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:21.805495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] PATH_INFO: `/v3/projects/5738677e6cbd4ffa80ff42c7743b36e8` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:21.805495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5738677e6cbd4ffa80ff42c7743b36e8)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:21.807155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:21.868863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5738677e6cbd4ffa80ff42c7743b36e8', 'request_id': 'req-cd214a5a-32b2-421d-add4-34952d8cb442'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.876306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5738677e6cbd4ffa80ff42c7743b36e8', 'request_id': 'req-cd214a5a-32b2-421d-add4-34952d8cb442'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.884502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5738677e6cbd4ffa80ff42c7743b36e8', 'request_id': 'req-cd214a5a-32b2-421d-add4-34952d8cb442'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.898311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] The token cache is being invalidate because project 5738677e6cbd4ffa80ff42c7743b36e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:21.898666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.899370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cd214a5a-32b2-421d-add4-34952d8cb442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:21.901377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 990/1976] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:21 2022] DELETE /identity/v3/projects/5738677e6cbd4ffa80ff42c7743b36e8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:21.906349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359cb0-c9ad-453c-8f1d-fba5830833c5 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:21.906676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359cb0-c9ad-453c-8f1d-fba5830833c5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:21.906969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359cb0-c9ad-453c-8f1d-fba5830833c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:21.927619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1d359cb0-c9ad-453c-8f1d-fba5830833c5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:21.929105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1d359cb0-c9ad-453c-8f1d-fba5830833c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:21.995084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 987/1977] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:22.004434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15059883-b3d7-4177-9ce3-9a35546ac6ff None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.004750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15059883-b3d7-4177-9ce3-9a35546ac6ff None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.005089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15059883-b3d7-4177-9ce3-9a35546ac6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.024765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-15059883-b3d7-4177-9ce3-9a35546ac6ff None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:22.025938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-15059883-b3d7-4177-9ce3-9a35546ac6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:22.035631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 991/1978] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:22.039974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359cb0-c9ad-453c-8f1d-fba5830833c5 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.050208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359cb0-c9ad-453c-8f1d-fba5830833c5 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.054799 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.055492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.055790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.056063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.056830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:22.057148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.058782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.071012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 988/1979] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:47:22.076024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15059883-b3d7-4177-9ce3-9a35546ac6ff None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.086565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15059883-b3d7-4177-9ce3-9a35546ac6ff None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.091439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.092097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.092381 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.092658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.093348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.095271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.121759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 992/1980] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:22 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:22.126243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.138295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c51e9e-845d-4693-8a05-e82bb266a67d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.214431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:22.229163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.230474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.230868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.232058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.232516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.234490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.255561 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 989/1981] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:22 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:22.259524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.271549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18691f9d-95ff-4063-8067-bb04e7e40578 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.277229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.278066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.278533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.279147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.279741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.281454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.294635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 993/1982] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:22.299063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.334371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310a7f-198d-4fa2-875d-ac8fddfbf289 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.351065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e6934-3ea1-455b-ad93-18dfa96d82ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.351976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6934-3ea1-455b-ad93-18dfa96d82ca admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.352272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6934-3ea1-455b-ad93-18dfa96d82ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.352554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6934-3ea1-455b-ad93-18dfa96d82ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.353627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e6934-3ea1-455b-ad93-18dfa96d82ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.355714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e6934-3ea1-455b-ad93-18dfa96d82ca admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.371092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 990/1983] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:22.375691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.386041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0095f-be46-49d3-bcda-bb7a2655b5b1 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.403953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.405031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.405346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.405699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] PATH_INFO: `/v3/projects/06fbe63c76e24af68a7e51316d443848/users/c9e342f0d0344361ab620c993003750b/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.423645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fbe63c76e24af68a7e51316d443848, user_id=c9e342f0d0344361ab620c993003750b, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.426841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.445399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 994/1984] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:22 2022] PUT /identity/v3/projects/06fbe63c76e24af68a7e51316d443848/users/c9e342f0d0344361ab620c993003750b/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:22.457868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850c885-d712-4ecd-95e4-585ae13f34a0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.458462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850c885-d712-4ecd-95e4-585ae13f34a0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.458613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850c885-d712-4ecd-95e4-585ae13f34a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.490685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2850c885-d712-4ecd-95e4-585ae13f34a0 None None] MFA Rules not processed for user `c9e342f0d0344361ab620c993003750b`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:22.491984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2850c885-d712-4ecd-95e4-585ae13f34a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:22.570558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 991/1985] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:22.575964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.639969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6566e96-6051-43dc-b028-df3dc16e6bed admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.644613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.645279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.645586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.645935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.646657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.648983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.682203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 995/1986] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:22 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:22.686861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850c885-d712-4ecd-95e4-585ae13f34a0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.698451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850c885-d712-4ecd-95e4-585ae13f34a0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.764711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.765401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.765712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.766284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.767389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.771004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.799410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 992/1987] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:22 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:22.803647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.816539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695341e5-9a69-4c11-b4fd-719490563c51 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.823317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.824480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.825313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.825566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.826703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.829045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.831818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:22.843992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 996/1988] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:22.848282 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.861697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec541a4-8449-4626-b045-720904ffa4bb admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:22.866784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:22.868355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:22.868355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:22.868355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] PATH_INFO: `/v3/projects/ba72b059c86c4a2db5bc6af24a6a3b21/users/2f83cca26e9d418dbef26779868285a7/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:22.885000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba72b059c86c4a2db5bc6af24a6a3b21, user_id=2f83cca26e9d418dbef26779868285a7, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:22.888231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:22.904590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 993/1989] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:22 2022] PUT /identity/v3/projects/ba72b059c86c4a2db5bc6af24a6a3b21/users/2f83cca26e9d418dbef26779868285a7/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:22.909744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:22.943174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6c2e-91c0-4e26-b3c9-9c38836d25d0 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:23.049596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646046d2-ebc0-4912-83c7-7fdc9660da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:23.050339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646046d2-ebc0-4912-83c7-7fdc9660da60 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:23.050618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646046d2-ebc0-4912-83c7-7fdc9660da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:23.050896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646046d2-ebc0-4912-83c7-7fdc9660da60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:23.051702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646046d2-ebc0-4912-83c7-7fdc9660da60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:23.054225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646046d2-ebc0-4912-83c7-7fdc9660da60 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:23.072903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 997/1990] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:23.074071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:23.091181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1876eae-ec09-46fa-acaf-4d5421b5e71d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:23.097192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:23.099054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:23.099386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:23.099684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] PATH_INFO: `/v3/projects/ba72b059c86c4a2db5bc6af24a6a3b21/users/2f83cca26e9d418dbef26779868285a7/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:23.101872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba72b059c86c4a2db5bc6af24a6a3b21, user_id=2f83cca26e9d418dbef26779868285a7, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:23.104786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:23.125680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 994/1991] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:23 2022] PUT /identity/v3/projects/ba72b059c86c4a2db5bc6af24a6a3b21/users/2f83cca26e9d418dbef26779868285a7/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:23.138701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a813-70ca-4205-8b7c-00e1067d5ee9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:23.138995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a813-70ca-4205-8b7c-00e1067d5ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:23.139329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a813-70ca-4205-8b7c-00e1067d5ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:23.202309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4685a813-70ca-4205-8b7c-00e1067d5ee9 None None] MFA Rules not processed for user `2f83cca26e9d418dbef26779868285a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:23.203654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4685a813-70ca-4205-8b7c-00e1067d5ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:23.290816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 998/1992] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:23.303643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:23.305389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:23.319175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:23.364743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea6513-4900-4409-bbd7-cbf7755b38db admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:23.368543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3f6bf-0504-439e-b7ca-e1097f144b04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:23.369479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3f6bf-0504-439e-b7ca-e1097f144b04 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:23.369874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3f6bf-0504-439e-b7ca-e1097f144b04 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:23.370158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3f6bf-0504-439e-b7ca-e1097f144b04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:23.379349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3f6bf-0504-439e-b7ca-e1097f144b04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:23.380820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3f6bf-0504-439e-b7ca-e1097f144b04 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:23.392743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 995/1993] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:24.132559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685a813-70ca-4205-8b7c-00e1067d5ee9 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:24.291696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685a813-70ca-4205-8b7c-00e1067d5ee9 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:24.311786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:24.312867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:24.313204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:24.314358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] PATH_INFO: `/v3/users/c9e342f0d0344361ab620c993003750b` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:24.320940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e342f0d0344361ab620c993003750b)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:24.323466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:24.366267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:24.417878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e342f0d0344361ab620c993003750b'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:24.437230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e342f0d0344361ab620c993003750b'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:24.438410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e342f0d0344361ab620c993003750b'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:24.470719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e342f0d0344361ab620c993003750b'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:24.491943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e342f0d0344361ab620c993003750b'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:24.504837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 999/1994] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:24 2022] DELETE /identity/v3/users/c9e342f0d0344361ab620c993003750b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:24.510190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:24.511276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:24.511711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:24.557738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:24.559017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:24.636437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 996/1995] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:24.645160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:24.658158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:24.771424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a17eee-fc07-4eb4-b06c-aeec191104fb admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:24.776168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:24.776733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:24.777021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:24.777301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:24.788068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:24.791514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:24.803402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1000/1996] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:25.360897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:25.362260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:25.410599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d7d9-7dec-4e4d-91c4-93f8351cc474 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:25.419227 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:25.420362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:25.421973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:25.422248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] PATH_INFO: `/v3/projects/06fbe63c76e24af68a7e51316d443848` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:25.425388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06fbe63c76e24af68a7e51316d443848)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:25.430425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:25.523733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06fbe63c76e24af68a7e51316d443848', 'request_id': 'req-53acc56c-4ba7-47cc-9bc7-826178c80c50'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.531406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06fbe63c76e24af68a7e51316d443848', 'request_id': 'req-53acc56c-4ba7-47cc-9bc7-826178c80c50'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.540418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06fbe63c76e24af68a7e51316d443848', 'request_id': 'req-53acc56c-4ba7-47cc-9bc7-826178c80c50'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.557886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] The token cache is being invalidate because project 06fbe63c76e24af68a7e51316d443848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:25.557886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.558548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.561193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 997/1997] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:25 2022] DELETE /identity/v3/projects/06fbe63c76e24af68a7e51316d443848 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:25.565324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:25.579028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8461-09fd-4706-b4c3-014aa5206a1e service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:25.640288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:25.641319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:25.641665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:25.641997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] PATH_INFO: `/v3/users/2f83cca26e9d418dbef26779868285a7` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:25.643367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f83cca26e9d418dbef26779868285a7)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:25.645444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:25.689378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:25.696329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f83cca26e9d418dbef26779868285a7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.712853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f83cca26e9d418dbef26779868285a7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.713591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f83cca26e9d418dbef26779868285a7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.722595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f83cca26e9d418dbef26779868285a7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.732856 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-4e870644-655a-4b20-b45c-65eca28d1086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f83cca26e9d418dbef26779868285a7'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:25.740074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1001/1998] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:25 2022] DELETE /identity/v3/users/2f83cca26e9d418dbef26779868285a7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:26.034026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.035855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:26.049536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc56c-4ba7-47cc-9bc7-826178c80c50 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.092285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:26.116400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.117265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.117549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.117826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] PATH_INFO: `/v3/projects/ba72b059c86c4a2db5bc6af24a6a3b21` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.118981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba72b059c86c4a2db5bc6af24a6a3b21)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.120908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.171329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba72b059c86c4a2db5bc6af24a6a3b21', 'request_id': 'req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:26.178136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba72b059c86c4a2db5bc6af24a6a3b21', 'request_id': 'req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:26.186973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba72b059c86c4a2db5bc6af24a6a3b21', 'request_id': 'req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:26.199610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] The token cache is being invalidate because project ba72b059c86c4a2db5bc6af24a6a3b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:26.199903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:26.200570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ebda2b7a-57fb-4830-a306-d06f6dbc56d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:26.202151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 998/1999] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:26 2022] DELETE /identity/v3/projects/ba72b059c86c4a2db5bc6af24a6a3b21 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:26.207072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605fcf-61f7-4a54-bcd1-b91c5113815d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.207403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605fcf-61f7-4a54-bcd1-b91c5113815d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.207692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605fcf-61f7-4a54-bcd1-b91c5113815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.226921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6d605fcf-61f7-4a54-bcd1-b91c5113815d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:26.228202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6d605fcf-61f7-4a54-bcd1-b91c5113815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:26.293131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1002/2000] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:26.301887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1df1-151a-4a97-8b7d-1cd7f3d488c7 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.302178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1df1-151a-4a97-8b7d-1cd7f3d488c7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.302460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1df1-151a-4a97-8b7d-1cd7f3d488c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.326514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c3db1df1-151a-4a97-8b7d-1cd7f3d488c7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:26.327783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c3db1df1-151a-4a97-8b7d-1cd7f3d488c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:26.336652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 999/2001] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:26.341548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605fcf-61f7-4a54-bcd1-b91c5113815d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.351038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605fcf-61f7-4a54-bcd1-b91c5113815d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.355755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.356409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.356776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.357003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.357780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:26.358037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.359929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.375854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1003/2002] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:26.380471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db1df1-151a-4a97-8b7d-1cd7f3d488c7 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.391387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db1df1-151a-4a97-8b7d-1cd7f3d488c7 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.396792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.396957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.397477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.397759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.398620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.400644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.435732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1000/2003] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:26 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:26.436754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.447590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b920a-7397-46fe-a19d-01f53e6d1b02 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.519254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.520256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.520709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.520994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.521717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.524027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.562252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1004/2004] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:26 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:26.563374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.586837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673134-33ac-43fd-a143-464a6d21f059 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.601617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.602541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.602893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.603266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.604299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.607405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.639502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1001/2005] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:26.643612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.655014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea0dcf-b9f4-49dc-a1fd-56d52ec07a1a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.660636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bf26c-5466-4b95-a1aa-9b689d8dac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.661744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf26c-5466-4b95-a1aa-9b689d8dac10 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.662172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf26c-5466-4b95-a1aa-9b689d8dac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.662589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf26c-5466-4b95-a1aa-9b689d8dac10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.663516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bf26c-5466-4b95-a1aa-9b689d8dac10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.665517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bf26c-5466-4b95-a1aa-9b689d8dac10 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.677540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1005/2006] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:26.683019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:26.705841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334837f-6bf8-4618-8b08-c8074f495bdc admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:26.713376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:26.714275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.714558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.714852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] PATH_INFO: `/v3/projects/b1749d838142432ea1cb1d0f8bd9d74b/users/9bb78d84a5cb41359bac84b86071bc36/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.748154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1749d838142432ea1cb1d0f8bd9d74b, user_id=9bb78d84a5cb41359bac84b86071bc36, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:26.751066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:26.776516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1002/2007] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:26 2022] PUT /identity/v3/projects/b1749d838142432ea1cb1d0f8bd9d74b/users/9bb78d84a5cb41359bac84b86071bc36/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:26.787919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb04a79-2a61-42e7-90cc-fa2505987f7b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:26.788243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb04a79-2a61-42e7-90cc-fa2505987f7b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:26.788507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb04a79-2a61-42e7-90cc-fa2505987f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:26.830472 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ccb04a79-2a61-42e7-90cc-fa2505987f7b None None] MFA Rules not processed for user `9bb78d84a5cb41359bac84b86071bc36`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:26.831985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ccb04a79-2a61-42e7-90cc-fa2505987f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:26.845152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:26.910642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1006/2008] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:26.915148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:27.007339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ec1b6-edd9-41c1-8e2c-398da394fe7f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:27.018485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:27.018485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.018485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.018485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.018849 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:27.020150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:27.030489 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:27.063411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1003/2009] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:26 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:27.067635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb04a79-2a61-42e7-90cc-fa2505987f7b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:27.086110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb04a79-2a61-42e7-90cc-fa2505987f7b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:27.202033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:27.202498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.202922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.203334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.204942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:27.209299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:27.233780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1007/2010] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:27 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:27.237470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:27.250477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef790833-cc96-4753-9638-58c437987a06 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:27.256696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:27.257485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.257862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.258208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.259018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:27.260759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:27.272633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1004/2011] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:27.276793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:27.288025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949c39b-5087-4e1b-9b84-effcbc57ab96 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:27.292897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:27.294389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.294812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.295104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] PATH_INFO: `/v3/projects/e127da0d60614d7cb75acaac90a3ee54/users/36d30e9b551a45929c274c5230503a33/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.316281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e127da0d60614d7cb75acaac90a3ee54, user_id=36d30e9b551a45929c274c5230503a33, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:27.322682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:27.337877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1008/2012] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:27 2022] PUT /identity/v3/projects/e127da0d60614d7cb75acaac90a3ee54/users/36d30e9b551a45929c274c5230503a33/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:27.341991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:27.352356 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6fc7c-3050-4f42-8dbf-4500dca1204f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:27.411117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767baed-623b-405b-a660-aac60fd22293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:27.411920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767baed-623b-405b-a660-aac60fd22293 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.412213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767baed-623b-405b-a660-aac60fd22293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.412501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767baed-623b-405b-a660-aac60fd22293 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.413263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767baed-623b-405b-a660-aac60fd22293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:27.414911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767baed-623b-405b-a660-aac60fd22293 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:27.428692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1005/2013] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:27.429882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:27.441656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ce776-61b6-40cc-bdd3-6fffbda42f2a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:27.446727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:27.447835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.448389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.448754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] PATH_INFO: `/v3/projects/e127da0d60614d7cb75acaac90a3ee54/users/36d30e9b551a45929c274c5230503a33/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.451047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e127da0d60614d7cb75acaac90a3ee54, user_id=36d30e9b551a45929c274c5230503a33, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:27.453981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:27.473973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1009/2014] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:27 2022] PUT /identity/v3/projects/e127da0d60614d7cb75acaac90a3ee54/users/36d30e9b551a45929c274c5230503a33/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:27.476488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55af9f-fb29-4bd5-8fdc-3a16dd6e0cf7 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.476787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55af9f-fb29-4bd5-8fdc-3a16dd6e0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.477074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55af9f-fb29-4bd5-8fdc-3a16dd6e0cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.506705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9a55af9f-fb29-4bd5-8fdc-3a16dd6e0cf7 None None] MFA Rules not processed for user `36d30e9b551a45929c274c5230503a33`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:27.507975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9a55af9f-fb29-4bd5-8fdc-3a16dd6e0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:27.596079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1006/2015] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:27.610762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:27.612548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:27.747844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2e9d6-c9ea-4931-8ee1-2a5e18762b90 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:27.758274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:27.758960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:27.759308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:27.759597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:27.771135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:27.773311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:27.784501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1010/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:28.197868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55af9f-fb29-4bd5-8fdc-3a16dd6e0cf7 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:28.212479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55af9f-fb29-4bd5-8fdc-3a16dd6e0cf7 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:28.221955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d30e9b551a45929c274c5230503a33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e127da0d60614d7cb75acaac90a3ee54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:28.222752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:28.223183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:28.223492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:28.224410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:28.224621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:28.226303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:28.241676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1007/2017] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:28.246040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:28.256949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801de78-9ef3-4784-bda0-585b38a40d3e service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:28.262678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d30e9b551a45929c274c5230503a33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e127da0d60614d7cb75acaac90a3ee54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:28.262991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:28.263317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:28.263601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:28.264313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:28.266219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:28.270612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:28.306703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1011/2018] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:28 2022] POST /identity/v3/projects => generated 355 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:28.312207 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:28.323516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d65c-783e-401e-8482-9273b1f72d39 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:28.382645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:28.404326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d30e9b551a45929c274c5230503a33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e127da0d60614d7cb75acaac90a3ee54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:28.405022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:28.405371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:28.405696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:28.407420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:28.407420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:28.408555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:28.421847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1008/2019] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:47:28.460636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:28.470844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616ed0-fc2c-402e-a12d-014fcd9a2aea tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:28.475348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d30e9b551a45929c274c5230503a33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e127da0d60614d7cb75acaac90a3ee54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:28.476199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:28.476517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:28.476797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] PATH_INFO: `/v3/projects/53d156bec1504625aff7408359bf6824` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:28.477969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorizing `identity:delete_project(project_id=53d156bec1504625aff7408359bf6824)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:28.479969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:28.526639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d156bec1504625aff7408359bf6824', 'request_id': 'req-6baade0e-51ce-4c76-931a-dded182e9e10'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.532106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d156bec1504625aff7408359bf6824', 'request_id': 'req-6baade0e-51ce-4c76-931a-dded182e9e10'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.539668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d156bec1504625aff7408359bf6824', 'request_id': 'req-6baade0e-51ce-4c76-931a-dded182e9e10'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.550639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] The token cache is being invalidate because project 53d156bec1504625aff7408359bf6824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:28.550932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.551783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6baade0e-51ce-4c76-931a-dded182e9e10 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.553533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1012/2020] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:28 2022] DELETE /identity/v3/projects/53d156bec1504625aff7408359bf6824 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:28.740766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:28.742519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:28.814496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888405eb-c956-47ef-b94c-8e06b2d7bbb3 tempest-VolumeQuotaClassesTest-977908785 tempest-VolumeQuotaClassesTest-977908785-project-admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:28.873962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:28.874841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:28.875128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:28.875440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] PATH_INFO: `/v3/users/9bb78d84a5cb41359bac84b86071bc36` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:28.876637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb78d84a5cb41359bac84b86071bc36)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:28.878577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:28.926289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb78d84a5cb41359bac84b86071bc36'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.940899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb78d84a5cb41359bac84b86071bc36'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.948542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb78d84a5cb41359bac84b86071bc36'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.956707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb78d84a5cb41359bac84b86071bc36'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.957401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb78d84a5cb41359bac84b86071bc36'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:28.963566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1009/2021] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:28 2022] DELETE /identity/v3/users/9bb78d84a5cb41359bac84b86071bc36 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:28.968873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:28.969326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:28.969440 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:28.989550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:28.991380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:29.056343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1013/2022] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:29.067273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:29.068710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:29.079234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:29.131980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c2138-6870-48e4-b5b7-2f1cc9b79951 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:29.135970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:29.136712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:29.137544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:29.139574 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:29.149286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:29.150740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:29.160058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1010/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:29.449177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:29.452329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:29.464656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b977a7-911a-4315-9fd6-1e465355c7ba None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:29.483356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:29.484385 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:29.484678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:29.484966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] PATH_INFO: `/v3/projects/b1749d838142432ea1cb1d0f8bd9d74b` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:29.486232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1749d838142432ea1cb1d0f8bd9d74b)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:29.488786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:29.536803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1749d838142432ea1cb1d0f8bd9d74b', 'request_id': 'req-66266926-b16e-4229-8c3c-1735aa0ed5ed'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.542527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1749d838142432ea1cb1d0f8bd9d74b', 'request_id': 'req-66266926-b16e-4229-8c3c-1735aa0ed5ed'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.550740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1749d838142432ea1cb1d0f8bd9d74b', 'request_id': 'req-66266926-b16e-4229-8c3c-1735aa0ed5ed'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.552104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:29.566854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] The token cache is being invalidate because project b1749d838142432ea1cb1d0f8bd9d74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:29.567225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.568044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.570173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1014/2024] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:29 2022] DELETE /identity/v3/projects/b1749d838142432ea1cb1d0f8bd9d74b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:29.573966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:29.583693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58896a-58eb-40af-b00f-b4ab14180d65 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:29.641766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:29.642637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:29.642919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:29.643194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] PATH_INFO: `/v3/users/36d30e9b551a45929c274c5230503a33` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:29.645629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d30e9b551a45929c274c5230503a33)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:29.647834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:29.696234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d30e9b551a45929c274c5230503a33'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.708835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d30e9b551a45929c274c5230503a33'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.717683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d30e9b551a45929c274c5230503a33'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.728309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d30e9b551a45929c274c5230503a33'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.729320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0cf4ce6b-1032-43c7-a696-04d59cda620e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d30e9b551a45929c274c5230503a33'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:29.745867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1011/2025] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:29 2022] DELETE /identity/v3/users/36d30e9b551a45929c274c5230503a33 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:30.092069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.093541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:30.108167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66266926-b16e-4229-8c3c-1735aa0ed5ed admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.181311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.182183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.182926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.182926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] PATH_INFO: `/v3/projects/e127da0d60614d7cb75acaac90a3ee54` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.183961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e127da0d60614d7cb75acaac90a3ee54)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.185911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.246174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e127da0d60614d7cb75acaac90a3ee54', 'request_id': 'req-a13d3343-896a-49cd-bcac-e50db4c31689'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:30.257303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e127da0d60614d7cb75acaac90a3ee54', 'request_id': 'req-a13d3343-896a-49cd-bcac-e50db4c31689'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:30.270040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e127da0d60614d7cb75acaac90a3ee54', 'request_id': 'req-a13d3343-896a-49cd-bcac-e50db4c31689'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:30.289249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] The token cache is being invalidate because project e127da0d60614d7cb75acaac90a3ee54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:30.289676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:30.291406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a13d3343-896a-49cd-bcac-e50db4c31689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:30.293577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1015/2026] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:30 2022] DELETE /identity/v3/projects/e127da0d60614d7cb75acaac90a3ee54 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:30.298146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56e2e-96b0-4f87-bb24-a4ba0fe431a6 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.298468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56e2e-96b0-4f87-bb24-a4ba0fe431a6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.298753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56e2e-96b0-4f87-bb24-a4ba0fe431a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.319721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d7d56e2e-96b0-4f87-bb24-a4ba0fe431a6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:30.321325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d7d56e2e-96b0-4f87-bb24-a4ba0fe431a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:30.352554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:30.394438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1012/2027] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:30.404302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7d6a-e620-4fdf-b8eb-d2ae0b8072a5 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.404608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7d6a-e620-4fdf-b8eb-d2ae0b8072a5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.404885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7d6a-e620-4fdf-b8eb-d2ae0b8072a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.422868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-382b7d6a-e620-4fdf-b8eb-d2ae0b8072a5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:30.424138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-382b7d6a-e620-4fdf-b8eb-d2ae0b8072a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:30.432099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1016/2028] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:30.436400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56e2e-96b0-4f87-bb24-a4ba0fe431a6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.446035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56e2e-96b0-4f87-bb24-a4ba0fe431a6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.451241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.451850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.452127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.452408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.453146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:30.453459 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.455066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.467395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1013/2029] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:30.471964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b7d6a-e620-4fdf-b8eb-d2ae0b8072a5 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.482107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b7d6a-e620-4fdf-b8eb-d2ae0b8072a5 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.487128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.487928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.488213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.488530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.489195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.491129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.519235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1017/2030] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:30 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:30.522748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.533202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a28d6-765e-4b5e-8a75-6f131fefc004 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.590588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.591297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.591588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.591868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.592551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.594486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.613324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1014/2031] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:30 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:30.617420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.628304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f965-19ef-4f2a-a0f0-a598c19c4641 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.632992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.633652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.633944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.634229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.634988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.636629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.647869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1018/2032] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:30.651865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.661664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a5fb5-dfd8-4665-9d5e-84e40fc77693 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.666312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ba36-8ad6-4d76-bd11-a0e0e281aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.666959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ba36-8ad6-4d76-bd11-a0e0e281aada admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.667277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ba36-8ad6-4d76-bd11-a0e0e281aada admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.667557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ba36-8ad6-4d76-bd11-a0e0e281aada admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.668373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ba36-8ad6-4d76-bd11-a0e0e281aada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.669958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ba36-8ad6-4d76-bd11-a0e0e281aada admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.679664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1015/2033] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:30.683580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.693865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538a105-691e-4929-bbb1-0f162ecd0583 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.698416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.699325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.700164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.700445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] PATH_INFO: `/v3/projects/5209bdc8e4694c9c9ecc3e0ab49b4ffb/users/75bcbce32eac4fa1a187d238ebb6cd74/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.714573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5209bdc8e4694c9c9ecc3e0ab49b4ffb, user_id=75bcbce32eac4fa1a187d238ebb6cd74, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.717178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.729393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1019/2034] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:30 2022] PUT /identity/v3/projects/5209bdc8e4694c9c9ecc3e0ab49b4ffb/users/75bcbce32eac4fa1a187d238ebb6cd74/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:30.740251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729eb9-ccba-4912-af94-4b8af1a7023d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.740547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729eb9-ccba-4912-af94-4b8af1a7023d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.740826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729eb9-ccba-4912-af94-4b8af1a7023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.767486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-26729eb9-ccba-4912-af94-4b8af1a7023d None None] MFA Rules not processed for user `75bcbce32eac4fa1a187d238ebb6cd74`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:30.768676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-26729eb9-ccba-4912-af94-4b8af1a7023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:30.831825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1016/2035] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:30.836315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.858475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:30.906655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7afc9d-354e-466b-83de-93bfab547160 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.911619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:30.912378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:30.912596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:30.912927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:30.913564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:30.915496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:30.951420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1020/2036] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:30 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:30.955657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729eb9-ccba-4912-af94-4b8af1a7023d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:30.967980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729eb9-ccba-4912-af94-4b8af1a7023d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:30.989986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:31.031354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:31.032037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.032335 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.032614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.033304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:31.035228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:31.069074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1017/2037] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:30 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:31.073546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:31.086265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6522c2-1bae-4b99-bcdc-78880ab9e2ae admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:31.091508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:31.092173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.092701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.092788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.093439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:31.095087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:31.105996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1021/2038] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:31.110525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:31.120967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae0042-84ef-44e0-8f52-d52d3e9fb8b0 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:31.125688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:31.126640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.126994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.127365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] PATH_INFO: `/v3/projects/81c7762ac68d44ce83f5a6ce00d42747/users/b16409f6d24b4e058f9b9b047590fb09/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.143277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c7762ac68d44ce83f5a6ce00d42747, user_id=b16409f6d24b4e058f9b9b047590fb09, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:31.146008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:31.161258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1018/2039] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:31 2022] PUT /identity/v3/projects/81c7762ac68d44ce83f5a6ce00d42747/users/b16409f6d24b4e058f9b9b047590fb09/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:31.165373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:31.177118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb57f9-88b1-4c7f-8288-01a079ab782a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:31.244635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46216cb-2573-465a-bcfd-783ae567d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:31.245332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46216cb-2573-465a-bcfd-783ae567d4ad admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.245617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46216cb-2573-465a-bcfd-783ae567d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.245899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46216cb-2573-465a-bcfd-783ae567d4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.247161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46216cb-2573-465a-bcfd-783ae567d4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:31.248836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46216cb-2573-465a-bcfd-783ae567d4ad admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:31.263813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1022/2040] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:31.265028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:31.276523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143658ea-9cca-4440-9819-2c2462f29afa admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:31.281429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:31.282405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.282731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.283031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] PATH_INFO: `/v3/projects/81c7762ac68d44ce83f5a6ce00d42747/users/b16409f6d24b4e058f9b9b047590fb09/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.286015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c7762ac68d44ce83f5a6ce00d42747, user_id=b16409f6d24b4e058f9b9b047590fb09, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:31.289869 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:31.301711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1019/2041] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:31 2022] PUT /identity/v3/projects/81c7762ac68d44ce83f5a6ce00d42747/users/b16409f6d24b4e058f9b9b047590fb09/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:31.313077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439fff-2b4d-49af-a1f9-79994ce6b01a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.313378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439fff-2b4d-49af-a1f9-79994ce6b01a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.313665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439fff-2b4d-49af-a1f9-79994ce6b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.341587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-19439fff-2b4d-49af-a1f9-79994ce6b01a None None] MFA Rules not processed for user `b16409f6d24b4e058f9b9b047590fb09`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:31.342871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-19439fff-2b4d-49af-a1f9-79994ce6b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:31.424894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1023/2042] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:31.437925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:31.439736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:31.504309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94f40-9e70-4c28-b0aa-7eaa12e5619f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:31.508308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:31.510165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.510165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.510165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.524497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:31.525994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:31.536995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1020/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:31.628124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439fff-2b4d-49af-a1f9-79994ce6b01a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:31.639505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439fff-2b4d-49af-a1f9-79994ce6b01a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:31.644820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853a067-3232-4b82-b9ef-0ded592e2f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:31.645511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a067-3232-4b82-b9ef-0ded592e2f15 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:31.645855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a067-3232-4b82-b9ef-0ded592e2f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:31.646148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a067-3232-4b82-b9ef-0ded592e2f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:31.667679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:31.723726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853a067-3232-4b82-b9ef-0ded592e2f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:31.725603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853a067-3232-4b82-b9ef-0ded592e2f15 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:31.737005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1024/2044] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:33.524481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:33.525979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:33.604966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec68b0-ea06-4d33-b2f7-6e29357a93f2 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:33.617639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:33.618838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:33.619474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:33.619910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] PATH_INFO: `/v3/users/ec6d8af9f84e4743a3f7b8803c8eaeb9` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:33.621685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6d8af9f84e4743a3f7b8803c8eaeb9)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:33.624180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:33.651159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:33.686586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6d8af9f84e4743a3f7b8803c8eaeb9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:33.704863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6d8af9f84e4743a3f7b8803c8eaeb9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:33.716678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6d8af9f84e4743a3f7b8803c8eaeb9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:33.735101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6d8af9f84e4743a3f7b8803c8eaeb9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:33.736066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6d8af9f84e4743a3f7b8803c8eaeb9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:33.745857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1021/2045] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:33 2022] DELETE /identity/v3/users/ec6d8af9f84e4743a3f7b8803c8eaeb9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:33.747449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:33.748343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:33.748834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:33.791093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:33.795489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:33.948393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1025/2046] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:33.977938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:33.979511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:34.120208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066168e4-618f-4e26-9ce2-dbdeabed5f81 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:34.124139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1165dd-7621-4fef-9435-658c5b4a47dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:34.124818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1165dd-7621-4fef-9435-658c5b4a47dc service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:34.125109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1165dd-7621-4fef-9435-658c5b4a47dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:34.125384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1165dd-7621-4fef-9435-658c5b4a47dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:34.137658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1165dd-7621-4fef-9435-658c5b4a47dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:34.139129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1165dd-7621-4fef-9435-658c5b4a47dc service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:34.156285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1022/2047] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:34.865565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:34.867065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:34.892338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f808cde-9642-4514-a70c-fb7ad9cd9da0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:34.914190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:34.915075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:34.915452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:34.915743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] PATH_INFO: `/v3/projects/5d18c013abe04dc5817684d5b4447716` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:34.920354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d18c013abe04dc5817684d5b4447716)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:34.922775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:35.019420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d18c013abe04dc5817684d5b4447716', 'request_id': 'req-97f48056-1d73-4262-8787-ab353f4299e2'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:35.032318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d18c013abe04dc5817684d5b4447716', 'request_id': 'req-97f48056-1d73-4262-8787-ab353f4299e2'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:35.045399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d18c013abe04dc5817684d5b4447716', 'request_id': 'req-97f48056-1d73-4262-8787-ab353f4299e2'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:35.070396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] The token cache is being invalidate because project 5d18c013abe04dc5817684d5b4447716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:35.071034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:35.071954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-97f48056-1d73-4262-8787-ab353f4299e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:35.073947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1026/2048] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:34 2022] DELETE /identity/v3/projects/5d18c013abe04dc5817684d5b4447716 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:35.078931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db4e7-0371-4821-9842-0c1a535ffd53 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.079480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db4e7-0371-4821-9842-0c1a535ffd53 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.079593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db4e7-0371-4821-9842-0c1a535ffd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.110835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1f4db4e7-0371-4821-9842-0c1a535ffd53 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:35.112661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1f4db4e7-0371-4821-9842-0c1a535ffd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:35.203568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b227-1ac6-42ca-b5c3-7e215b456ac4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.203667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b227-1ac6-42ca-b5c3-7e215b456ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.203974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b227-1ac6-42ca-b5c3-7e215b456ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.213485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1023/2049] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:35.238085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-3f33b227-1ac6-42ca-b5c3-7e215b456ac4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:35.241650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3f33b227-1ac6-42ca-b5c3-7e215b456ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:35.275814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1027/2050] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:35.280726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db4e7-0371-4821-9842-0c1a535ffd53 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:35.295996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db4e7-0371-4821-9842-0c1a535ffd53 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:35.335474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:35.336621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.336621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.339488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.344267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:35.344753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:35.350327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:35.382575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1024/2051] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:35.385830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33b227-1ac6-42ca-b5c3-7e215b456ac4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:35.405938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33b227-1ac6-42ca-b5c3-7e215b456ac4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:35.416208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:35.416902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.417191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.417474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.418398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:35.420391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:35.530335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1028/2052] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:35 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:35.531423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:35.549298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1efa5-4471-4d56-92d3-b1face145970 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:35.652223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:35.721300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:35.722114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.722432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.722839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.723901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:35.726553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:35.758446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1025/2053] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:35 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:35.763694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:35.776383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3cec-4b35-43ea-af2f-2051de51c2b4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:35.790501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:35.791197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.791515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.791795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.793037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:35.795243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:35.798596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:35.820339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1029/2054] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:35.823904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:35.834420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5b04a-3d9c-4150-bfe3-4902ee6510f3 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:35.840457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef08ed-2c61-439a-a5da-10764015e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:35.841347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef08ed-2c61-439a-a5da-10764015e1af admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.841793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef08ed-2c61-439a-a5da-10764015e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.842123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef08ed-2c61-439a-a5da-10764015e1af admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.843051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef08ed-2c61-439a-a5da-10764015e1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:35.844993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef08ed-2c61-439a-a5da-10764015e1af admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:35.860628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1026/2055] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:35.864608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:35.879325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747320-8fe9-491a-87ed-5b6a5c18737d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:35.886447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:35.887634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.888101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.888554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] PATH_INFO: `/v3/projects/6edd725e6f104dafb3dd13617d245749/users/3eeef152335e458a9ffdc45eb8ee1653/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.912540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edd725e6f104dafb3dd13617d245749, user_id=3eeef152335e458a9ffdc45eb8ee1653, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:35.916401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:35.941444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1030/2056] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:35 2022] PUT /identity/v3/projects/6edd725e6f104dafb3dd13617d245749/users/3eeef152335e458a9ffdc45eb8ee1653/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:35.952370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0b64-12ad-4180-8048-3e3193959412 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:35.952751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0b64-12ad-4180-8048-3e3193959412 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:35.953118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0b64-12ad-4180-8048-3e3193959412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:35.981345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-aa4f0b64-12ad-4180-8048-3e3193959412 None None] MFA Rules not processed for user `3eeef152335e458a9ffdc45eb8ee1653`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:35.982626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-aa4f0b64-12ad-4180-8048-3e3193959412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.050078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1027/2057] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:36.054614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.156011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec9f7-7ad9-431b-8b37-a0e1322d68f3 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.165094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.166355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.166843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.167337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.168302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.171012 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.203748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1031/2058] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:36.208536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f0b64-12ad-4180-8048-3e3193959412 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.228363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f0b64-12ad-4180-8048-3e3193959412 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.295235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.296154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.296495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.296838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.297620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.299669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.325132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1028/2059] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:36.328727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.345070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb6024-46d0-42d4-ac1e-305e218f64d9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.349587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.350242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.350525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.350800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.351545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.353167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.363672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1032/2060] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:36.368924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.379077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6df4-c1f6-490f-afca-2a9148d66d41 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.383663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdae9d-9e4f-449d-b475-19d0f2255c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.384324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdae9d-9e4f-449d-b475-19d0f2255c8d admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.384609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdae9d-9e4f-449d-b475-19d0f2255c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.384887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdae9d-9e4f-449d-b475-19d0f2255c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.385634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdae9d-9e4f-449d-b475-19d0f2255c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.388004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdae9d-9e4f-449d-b475-19d0f2255c8d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.398222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1029/2061] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:36.402364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.413153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0996f-5062-4f82-ad37-5cb195ac401a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.420041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec953d-752b-4fcf-b0dd-a749649f3e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.421084 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec953d-752b-4fcf-b0dd-a749649f3e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.421507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec953d-752b-4fcf-b0dd-a749649f3e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.421806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec953d-752b-4fcf-b0dd-a749649f3e42 admin admin] PATH_INFO: `/v3/projects/e07753de829a4a7d9624d9620cd18feb/users/bc72b728c2ac4d71b625d3e7213d17f9/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.436643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec953d-752b-4fcf-b0dd-a749649f3e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07753de829a4a7d9624d9620cd18feb, user_id=bc72b728c2ac4d71b625d3e7213d17f9, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.439644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec953d-752b-4fcf-b0dd-a749649f3e42 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.452830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1033/2062] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:36 2022] PUT /identity/v3/projects/e07753de829a4a7d9624d9620cd18feb/users/bc72b728c2ac4d71b625d3e7213d17f9/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:36.464105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89e0d-4df0-48ce-940a-ec42bb1f3107 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.464408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89e0d-4df0-48ce-940a-ec42bb1f3107 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.464700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc89e0d-4df0-48ce-940a-ec42bb1f3107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.494529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4cc89e0d-4df0-48ce-940a-ec42bb1f3107 None None] MFA Rules not processed for user `bc72b728c2ac4d71b625d3e7213d17f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:36.495784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4cc89e0d-4df0-48ce-940a-ec42bb1f3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.500399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:36.552452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ec93-0d5d-4862-a2c3-fd83f68ddce5 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.552744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ec93-0d5d-4862-a2c3-fd83f68ddce5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.553028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ec93-0d5d-4862-a2c3-fd83f68ddce5 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.554390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1034/2063] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:47:36.568111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335239ba-aea9-487b-abdd-0e409e536e6d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.568399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335239ba-aea9-487b-abdd-0e409e536e6d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.568677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335239ba-aea9-487b-abdd-0e409e536e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.575246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1030/2064] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:36.576116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc89e0d-4df0-48ce-940a-ec42bb1f3107 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.602249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-335239ba-aea9-487b-abdd-0e409e536e6d None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:36.602249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-335239ba-aea9-487b-abdd-0e409e536e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.673406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc89e0d-4df0-48ce-940a-ec42bb1f3107 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.678299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.678975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.679300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.679583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.680284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.682335 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.713080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1031/2065] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:36.713925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.716052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.729926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1035/2066] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:36.731164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335239ba-aea9-487b-abdd-0e409e536e6d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.761633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335239ba-aea9-487b-abdd-0e409e536e6d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.794613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:36.817324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c3683-9066-45be-966c-4ea4c16d5f30 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:36.825154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.826081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.826725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.827006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] PATH_INFO: `/v3/users/053edeb07da24a7a8678eb0ba7e0a915` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.828306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=053edeb07da24a7a8678eb0ba7e0a915)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.830566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.887332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:36.892707 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:36.894305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:36.894833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:36.895427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:36.896586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:36.899914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:36.903360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053edeb07da24a7a8678eb0ba7e0a915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.920692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053edeb07da24a7a8678eb0ba7e0a915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.933189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053edeb07da24a7a8678eb0ba7e0a915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.937675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1036/2067] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:36 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:36.938686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.940748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:36.941614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053edeb07da24a7a8678eb0ba7e0a915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.942335 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053edeb07da24a7a8678eb0ba7e0a915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:36.954200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1032/2068] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:36 2022] DELETE /identity/v3/users/053edeb07da24a7a8678eb0ba7e0a915 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:36.955175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:36.956935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.061034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0b76e-9c14-46d8-9142-f02c227cf1e8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.118352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22b4db-0fcc-4320-9007-02fa113a6edf admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.133664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.134484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.135090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.135581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.136425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.138868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.172149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.173017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.173129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.173422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.175668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.176683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1033/2069] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:37.179260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.192037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.197101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.201695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9be8-14fd-4784-8bbf-c833800a5a9b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.213890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.215341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.215648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.215928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] PATH_INFO: `/v3/projects/03cab30c91574146ad5d3c89ab688008/users/6ad1c2defdc544bf8ba53b7e47862dbb/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.218874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1037/2070] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:37.247120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cab30c91574146ad5d3c89ab688008, user_id=6ad1c2defdc544bf8ba53b7e47862dbb, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.249827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.266790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1034/2071] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:37 2022] PUT /identity/v3/projects/03cab30c91574146ad5d3c89ab688008/users/6ad1c2defdc544bf8ba53b7e47862dbb/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:37.271494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.292612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267b00-db52-4a70-816d-8f4db1fe2285 service placement] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.304075 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.306357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.402234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddee3-7129-4845-bd6f-0ede16b75569 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.402942 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:37.411935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.413084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.414223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.414838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] PATH_INFO: `/v3/users/75bcbce32eac4fa1a187d238ebb6cd74` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.418820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bcbce32eac4fa1a187d238ebb6cd74)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.421869 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.438401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.439764 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.439878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.440745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.443023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.446347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.454441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:37.476369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1038/2072] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:37.477402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.488801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.492446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bcbce32eac4fa1a187d238ebb6cd74'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.508549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bcbce32eac4fa1a187d238ebb6cd74'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.512860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fa7c4-a28e-4927-a92e-dbe4cfd31ed6 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.519156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bcbce32eac4fa1a187d238ebb6cd74'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.519934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.521028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.521329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.523413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] PATH_INFO: `/v3/projects/bd58bd3bc6a1459d88f74cd343e0827b` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.524683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd58bd3bc6a1459d88f74cd343e0827b)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.526744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.530137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bcbce32eac4fa1a187d238ebb6cd74'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.531025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bcbce32eac4fa1a187d238ebb6cd74'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.538295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1035/2073] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:37 2022] DELETE /identity/v3/users/75bcbce32eac4fa1a187d238ebb6cd74 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:37.541866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.543911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.592619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd58bd3bc6a1459d88f74cd343e0827b', 'request_id': 'req-e769a0eb-a202-43f9-aa44-1a298c7eb36d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.600697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd58bd3bc6a1459d88f74cd343e0827b', 'request_id': 'req-e769a0eb-a202-43f9-aa44-1a298c7eb36d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.609572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd58bd3bc6a1459d88f74cd343e0827b', 'request_id': 'req-e769a0eb-a202-43f9-aa44-1a298c7eb36d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.622357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0099c-3620-4fd5-b2b9-e281955b8157 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.622850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] The token cache is being invalidate because project bd58bd3bc6a1459d88f74cd343e0827b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:37.623279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.624583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e769a0eb-a202-43f9-aa44-1a298c7eb36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:37.626467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1039/2074] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:37 2022] DELETE /identity/v3/projects/bd58bd3bc6a1459d88f74cd343e0827b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:37.627554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bdfac-aa9f-4f0e-b338-9faa661106f3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.627877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bdfac-aa9f-4f0e-b338-9faa661106f3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.628139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bdfac-aa9f-4f0e-b338-9faa661106f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.644643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-3f1bdfac-aa9f-4f0e-b338-9faa661106f3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:37.645843 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3f1bdfac-aa9f-4f0e-b338-9faa661106f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.680520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1029cb-2404-46d3-bd86-1f6e30091c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.681418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1029cb-2404-46d3-bd86-1f6e30091c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.681706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1029cb-2404-46d3-bd86-1f6e30091c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.681988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1029cb-2404-46d3-bd86-1f6e30091c1d admin admin] PATH_INFO: `/v3/projects/03cab30c91574146ad5d3c89ab688008/users/6ad1c2defdc544bf8ba53b7e47862dbb/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.684518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1029cb-2404-46d3-bd86-1f6e30091c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cab30c91574146ad5d3c89ab688008, user_id=6ad1c2defdc544bf8ba53b7e47862dbb, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.687173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1029cb-2404-46d3-bd86-1f6e30091c1d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.698064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1036/2075] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:37 2022] PUT /identity/v3/projects/03cab30c91574146ad5d3c89ab688008/users/6ad1c2defdc544bf8ba53b7e47862dbb/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:37.699568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.699714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.699981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.707849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1040/2076] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:37.709117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d8f7-011f-4f2c-9e6d-1c5b07c8d6ea None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.709415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d8f7-011f-4f2c-9e6d-1c5b07c8d6ea None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.709701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d8f7-011f-4f2c-9e6d-1c5b07c8d6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.720070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:37.721341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.736024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2661d8f7-011f-4f2c-9e6d-1c5b07c8d6ea None None] MFA Rules not processed for user `6ad1c2defdc544bf8ba53b7e47862dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:37.737220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2661d8f7-011f-4f2c-9e6d-1c5b07c8d6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.763641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:37.789090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1037/2077] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:37.789852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.791159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.796428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:37.833008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1041/2078] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:37.833008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.833008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.833008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.853826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697a4ff-57b0-454f-b976-4c25cce1c72e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.854456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:37.856223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.857957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.858601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.858882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.859162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.864414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1042/2079] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:37.868424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.869325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.869425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:37.870783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.882755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1038/2080] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:37.883484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.893494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44889ae5-a530-445e-8fc6-1e3d79b84ff0 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.898945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.899683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.899966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.900915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.901107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:37.901590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.903392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.926862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1039/2081] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:37.928362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:37.941403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1e9b2-101e-4983-8eef-3eaff270d56f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.949641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:37.950967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:37.951488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:37.951966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:37.953334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:37.955812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:37.992361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0c370-8382-411e-87c1-b810e3d1f127 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:37.994257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1040/2082] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:37 2022] POST /identity/v3/projects => generated 405 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:38.004545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.085606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.086323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.086615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.087305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.093298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:38.105130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fe3f6-8c3f-4efd-bfe8-1f86f014ce85 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.113571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.114878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.115763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.116099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.116988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.118952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.146465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1041/2083] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:38 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:38.150965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.163034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb545de-7f53-4a36-9b1a-7ca5570f988d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.168589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.169358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.169644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.169929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.170661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.172296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.185016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.186922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.187256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1042/2084] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:38.188162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.198740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec419a1-5b6e-4143-bd10-a54b903ac1a3 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.202206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1043/2085] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:38.203958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.204743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.205098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.205444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.206362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.208080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.219966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1043/2086] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:38.224219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.242294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819539b1-9402-462a-ab15-c4f4f1e1bff4 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.248541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee75d2d-b8f7-4d0f-ae4e-942e6af7c911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.250195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee75d2d-b8f7-4d0f-ae4e-942e6af7c911 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.250565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee75d2d-b8f7-4d0f-ae4e-942e6af7c911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.250850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee75d2d-b8f7-4d0f-ae4e-942e6af7c911 admin admin] PATH_INFO: `/v3/projects/4abfd6fca18844d59ab40d54b592d902/users/a0c4ad16f2ad48a2bd784d209a7e820f/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.263251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.265606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:38.290169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564983b-994e-4717-8f64-c8397a5f900c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.299166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.300073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.300363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.300704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] PATH_INFO: `/v3/projects/5209bdc8e4694c9c9ecc3e0ab49b4ffb` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.300881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee75d2d-b8f7-4d0f-ae4e-942e6af7c911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abfd6fca18844d59ab40d54b592d902, user_id=a0c4ad16f2ad48a2bd784d209a7e820f, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.301840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5209bdc8e4694c9c9ecc3e0ab49b4ffb)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.303830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.307545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee75d2d-b8f7-4d0f-ae4e-942e6af7c911 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.337570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:38.340473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1044/2087] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:38 2022] PUT /identity/v3/projects/4abfd6fca18844d59ab40d54b592d902/users/a0c4ad16f2ad48a2bd784d209a7e820f/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:38.342144 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.342510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.342957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.378755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] MFA Rules not processed for user `a0c4ad16f2ad48a2bd784d209a7e820f`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:38.380847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:38.385192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5209bdc8e4694c9c9ecc3e0ab49b4ffb', 'request_id': 'req-2be06791-a548-4c24-b59a-421750d2da2e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.396106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:38.401067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5209bdc8e4694c9c9ecc3e0ab49b4ffb', 'request_id': 'req-2be06791-a548-4c24-b59a-421750d2da2e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.412091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5209bdc8e4694c9c9ecc3e0ab49b4ffb', 'request_id': 'req-2be06791-a548-4c24-b59a-421750d2da2e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.426323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] The token cache is being invalidate because project 5209bdc8e4694c9c9ecc3e0ab49b4ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:38.426615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.427298 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.429627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1044/2088] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:38 2022] DELETE /identity/v3/projects/5209bdc8e4694c9c9ecc3e0ab49b4ffb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:38.434987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.436384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:38.471967 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1045/2089] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:38.476564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.478098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:38.518824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06791-a548-4c24-b59a-421750d2da2e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.525871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.526764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.527070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.527957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] PATH_INFO: `/v3/users/b16409f6d24b4e058f9b9b047590fb09` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.529949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16409f6d24b4e058f9b9b047590fb09)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.532366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.571092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e13e92-6e0a-4aa8-a460-eb58cebf967c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.583164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.584075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.584488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.585096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.586065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.587954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.625201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1046/2090] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:38 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:38.628133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16409f6d24b4e058f9b9b047590fb09'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.635906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.643068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16409f6d24b4e058f9b9b047590fb09'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.653710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16409f6d24b4e058f9b9b047590fb09'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.661899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16409f6d24b4e058f9b9b047590fb09'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.662614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16409f6d24b4e058f9b9b047590fb09'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:38.669581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1045/2091] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:38 2022] DELETE /identity/v3/users/b16409f6d24b4e058f9b9b047590fb09 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:38.722678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0b66-57b9-4bc6-bb0a-37f7c9968de2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.770297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:38.784736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.785451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.785735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.786015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.786705 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.788756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.810642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1047/2092] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:38 2022] POST /identity/v3/users => generated 309 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:38.817159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.819299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:38.838263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9db6de-187f-41e5-8e67-1725df2c8c76 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.843848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.844570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.844857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.845135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.845900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.847594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.857932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1046/2093] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:38.862013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.872254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702ecbd-a779-482e-8774-02eba0c2b62f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.876842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:38.877775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:38.878067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:38.878342 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] PATH_INFO: `/v3/projects/bdb55dd6d2604245afffbc3ff176e327/users/710abbda3ce54fbdb29ed335f2df35d3/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:38.898526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb55dd6d2604245afffbc3ff176e327, user_id=710abbda3ce54fbdb29ed335f2df35d3, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:38.901303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:38.915546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1048/2094] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:38 2022] PUT /identity/v3/projects/bdb55dd6d2604245afffbc3ff176e327/users/710abbda3ce54fbdb29ed335f2df35d3/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:38.919520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.929406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b25d9-6216-4f42-a9d7-57dcdeb4692b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:38.935784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:38.965058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:38.967490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.004629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.005395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.005773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.006059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.006798 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.008616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.024407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1047/2095] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:39.025597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.036052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff40d1f-e50a-4fa5-b680-105aab8e027e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.037829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf1c4-fa55-4b4f-bdb1-aea6ab74dc04 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.042689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.043636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.043929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715554-92bd-46b5-a31b-94061671eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.044080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.044215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] PATH_INFO: `/v3/projects/81c7762ac68d44ce83f5a6ce00d42747` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.044860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715554-92bd-46b5-a31b-94061671eb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.045187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715554-92bd-46b5-a31b-94061671eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.045423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715554-92bd-46b5-a31b-94061671eb32 admin admin] PATH_INFO: `/v3/projects/bdb55dd6d2604245afffbc3ff176e327/users/710abbda3ce54fbdb29ed335f2df35d3/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.045539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c7762ac68d44ce83f5a6ce00d42747)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.047400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.047518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715554-92bd-46b5-a31b-94061671eb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb55dd6d2604245afffbc3ff176e327, user_id=710abbda3ce54fbdb29ed335f2df35d3, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.050123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715554-92bd-46b5-a31b-94061671eb32 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.062647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1048/2096] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:39 2022] PUT /identity/v3/projects/bdb55dd6d2604245afffbc3ff176e327/users/710abbda3ce54fbdb29ed335f2df35d3/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:39.073802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.074752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.075663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.106136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] MFA Rules not processed for user `710abbda3ce54fbdb29ed335f2df35d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:39.106737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.108811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c7762ac68d44ce83f5a6ce00d42747', 'request_id': 'req-05e44a74-71ad-43fc-9409-d34419cce42a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.114894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c7762ac68d44ce83f5a6ce00d42747', 'request_id': 'req-05e44a74-71ad-43fc-9409-d34419cce42a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.124800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c7762ac68d44ce83f5a6ce00d42747', 'request_id': 'req-05e44a74-71ad-43fc-9409-d34419cce42a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.147376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] The token cache is being invalidate because project 81c7762ac68d44ce83f5a6ce00d42747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:39.147376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.148128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-05e44a74-71ad-43fc-9409-d34419cce42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.153377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1049/2097] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:38 2022] DELETE /identity/v3/projects/81c7762ac68d44ce83f5a6ce00d42747 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:39.154784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c8a7-1160-4f92-9613-faba600bdd00 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.155072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c8a7-1160-4f92-9613-faba600bdd00 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.155375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c8a7-1160-4f92-9613-faba600bdd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.176328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ebf0c8a7-1160-4f92-9613-faba600bdd00 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:39.177801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ebf0c8a7-1160-4f92-9613-faba600bdd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.194416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1049/2098] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:39.206800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.208424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.223977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:39.261107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1050/2099] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:39.269030 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac13cdb-6d2e-4e8f-9529-579e2cfaadd7 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.269497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac13cdb-6d2e-4e8f-9529-579e2cfaadd7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.269784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac13cdb-6d2e-4e8f-9529-579e2cfaadd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.275299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1a44-2d04-4398-93c3-e786fd3e9f2c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.279547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.280197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.280506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.280789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.289870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-dac13cdb-6d2e-4e8f-9529-579e2cfaadd7 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:39.291073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-dac13cdb-6d2e-4e8f-9529-579e2cfaadd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.291830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.293366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.299171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1051/2100] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:39.303014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1050/2101] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:39.303137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac13cdb-6d2e-4e8f-9529-579e2cfaadd7 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.312758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac13cdb-6d2e-4e8f-9529-579e2cfaadd7 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.317684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.318348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.318643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.318929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.319729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:39.320042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.321695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.343060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1052/2102] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:47:39.347700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.358873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbcab0-d4a9-4743-8893-c41b30c39be7 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.363506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.364162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.364454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.364737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.365448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.367487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.387490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:39.396333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1051/2103] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:39.400740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.417395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad1d34-e982-44eb-949f-cc7b9351cdb2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.457895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.460264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.499257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.500096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.500391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.500774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.501368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.505808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.528927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1053/2104] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:39.532916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.543621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb2ccc-74b9-4c9f-a3f4-1cd333a149b8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.547737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31650496-fbac-4182-9a8f-9b304f545af7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.550509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.551488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.551800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.552082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] PATH_INFO: `/v3/users/a0c4ad16f2ad48a2bd784d209a7e820f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.552480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.553145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.553342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c4ad16f2ad48a2bd784d209a7e820f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.553446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.553683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.554413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.555390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.556019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.566300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1054/2105] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:39.570103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.580289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53a77-7313-4557-b592-2fd9b4b26760 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.585643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.586290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.586581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.586864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.587749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.589513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.601038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1055/2106] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:39.604945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.605088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c4ad16f2ad48a2bd784d209a7e820f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.615374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d5264-9998-41af-8519-7daa4bae7247 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.617931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c4ad16f2ad48a2bd784d209a7e820f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.620033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f47be-160b-4dbe-afb7-153c33238cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.620893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f47be-160b-4dbe-afb7-153c33238cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.621211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f47be-160b-4dbe-afb7-153c33238cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.621494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f47be-160b-4dbe-afb7-153c33238cc3 admin admin] PATH_INFO: `/v3/projects/738a16d200974ede8b399cc7f35b5b49/users/0766c0a3016849c59c6c3d1613de5e5c/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.625745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c4ad16f2ad48a2bd784d209a7e820f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.633039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c4ad16f2ad48a2bd784d209a7e820f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.633699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec5cd507-2fa4-4e60-a4b2-0f1f53bcc645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c4ad16f2ad48a2bd784d209a7e820f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:39.636983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f47be-160b-4dbe-afb7-153c33238cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738a16d200974ede8b399cc7f35b5b49, user_id=0766c0a3016849c59c6c3d1613de5e5c, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.640158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f47be-160b-4dbe-afb7-153c33238cc3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.649324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1052/2107] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:39 2022] DELETE /identity/v3/users/a0c4ad16f2ad48a2bd784d209a7e820f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:39.656149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.659553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.659940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.664222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1056/2108] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:39 2022] PUT /identity/v3/projects/738a16d200974ede8b399cc7f35b5b49/users/0766c0a3016849c59c6c3d1613de5e5c/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:39.676721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.677338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.677847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.679995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:39.681768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.726827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] MFA Rules not processed for user `0766c0a3016849c59c6c3d1613de5e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:39.728931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.756895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1053/2109] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:39.768024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.769770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.797796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:39.808716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:39.821258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1057/2110] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:39.822277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.829572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.848738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b451a5-82ca-410c-9533-681c37f3d9cb None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.848941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c36cf-2cdc-4f0f-aae1-c37f45d425db None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.852932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.853678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.853999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.854340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.856032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.857341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.857692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.857986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.859075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.861041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.867967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.869322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:39.881094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1054/2111] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:39.895607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.900144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:39.905040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1058/2112] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:39.907620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:39.966523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f46504-ab1b-4dc2-8867-303e6704bfbf service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.978980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64491ea-679e-4bee-86fa-a6b8f62e4e48 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:39.985193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:39.985935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:39.986236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:39.986514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:39.987303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:39.989567 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.014499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1059/2113] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:39 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:40.020344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:40.031434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444edcf6-3091-4fcb-b3e9-c8d17b799e42 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:40.036790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.037504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.037789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.038070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.038840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.040430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.040628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.041444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.041897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.042901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.044270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:40.051854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1060/2114] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:40.056207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:40.069664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde4fa2-9700-4cb9-a919-a0e52586ee88 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:40.075812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.077003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.077300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.077587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] PATH_INFO: `/v3/projects/c5f79fdc0d494cdea5b4fde70e0b1322/users/9ea886eda4a742beab8bfc0377ff7781/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.096131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f79fdc0d494cdea5b4fde70e0b1322, user_id=9ea886eda4a742beab8bfc0377ff7781, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.099057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.118088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1061/2115] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:40 2022] PUT /identity/v3/projects/c5f79fdc0d494cdea5b4fde70e0b1322/users/9ea886eda4a742beab8bfc0377ff7781/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:40.120575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.122166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.122599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:40.132301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1055/2116] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:40.199035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:40.201445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:40.218174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d7675-5040-47fd-94a8-db6952f43400 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:40.218629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b87e-c7cd-4c56-8e7f-ef8feab8dcd9 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:40.223302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.224217 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.224406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.224739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.225123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.225895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.226071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.226350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.226640 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] PATH_INFO: `/v3/projects/4abfd6fca18844d59ab40d54b592d902` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.228013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.228349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abfd6fca18844d59ab40d54b592d902)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.230432 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.243595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1062/2117] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:40.248449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:40.263787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a25a1f-fd59-4f92-85e9-719390a8a38b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:40.271623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c81e3-85ca-4c17-9e5b-756ef7111c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.272776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c81e3-85ca-4c17-9e5b-756ef7111c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.273077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c81e3-85ca-4c17-9e5b-756ef7111c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.273360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c81e3-85ca-4c17-9e5b-756ef7111c9c admin admin] PATH_INFO: `/v3/projects/c5f79fdc0d494cdea5b4fde70e0b1322/users/9ea886eda4a742beab8bfc0377ff7781/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.274845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:40.276178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c81e3-85ca-4c17-9e5b-756ef7111c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f79fdc0d494cdea5b4fde70e0b1322, user_id=9ea886eda4a742beab8bfc0377ff7781, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.280297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c81e3-85ca-4c17-9e5b-756ef7111c9c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.300351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1063/2118] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:40 2022] PUT /identity/v3/projects/c5f79fdc0d494cdea5b4fde70e0b1322/users/9ea886eda4a742beab8bfc0377ff7781/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:40.312139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df373a-dc16-47a9-a464-9318f491061b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.312749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df373a-dc16-47a9-a464-9318f491061b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.313460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df373a-dc16-47a9-a464-9318f491061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.314923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abfd6fca18844d59ab40d54b592d902', 'request_id': 'req-8a9f2644-0218-4997-9993-77d7eff43fe3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.324213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abfd6fca18844d59ab40d54b592d902', 'request_id': 'req-8a9f2644-0218-4997-9993-77d7eff43fe3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.333495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abfd6fca18844d59ab40d54b592d902', 'request_id': 'req-8a9f2644-0218-4997-9993-77d7eff43fe3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.347661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:40.352552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] The token cache is being invalidate because project 4abfd6fca18844d59ab40d54b592d902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:40.353661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-42df373a-dc16-47a9-a464-9318f491061b None None] MFA Rules not processed for user `9ea886eda4a742beab8bfc0377ff7781`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:40.353779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.354115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-42df373a-dc16-47a9-a464-9318f491061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:40.355658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.358199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1056/2119] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:40 2022] DELETE /identity/v3/projects/4abfd6fca18844d59ab40d54b592d902 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:40.362169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:40.363602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:40.470882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1064/2120] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:40.483779 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df373a-dc16-47a9-a464-9318f491061b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:40.484472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f2644-0218-4997-9993-77d7eff43fe3 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:40.484626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-42df373a-dc16-47a9-a464-9318f491061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:40.573310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df373a-dc16-47a9-a464-9318f491061b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:40.580088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.580768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.581153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.581724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.584667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:40.585662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:40.586072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:40.586419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] PATH_INFO: `/v3/users/710abbda3ce54fbdb29ed335f2df35d3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:40.587718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=710abbda3ce54fbdb29ed335f2df35d3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.589783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.597333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:40.598975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:40.614875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1065/2121] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:40.663699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710abbda3ce54fbdb29ed335f2df35d3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.681989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:40.684879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710abbda3ce54fbdb29ed335f2df35d3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.703087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710abbda3ce54fbdb29ed335f2df35d3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.718069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710abbda3ce54fbdb29ed335f2df35d3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.718686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710abbda3ce54fbdb29ed335f2df35d3'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:40.729333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1057/2122] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:40 2022] DELETE /identity/v3/users/710abbda3ce54fbdb29ed335f2df35d3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:41.001212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.003109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.013818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab94fe9-f7d1-47a6-860f-b5a86facf99a service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.078986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa5885-599e-4edd-9cad-e8381cc83d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.079763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa5885-599e-4edd-9cad-e8381cc83d06 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.080323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa5885-599e-4edd-9cad-e8381cc83d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.080529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa5885-599e-4edd-9cad-e8381cc83d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.086470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.087921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.088310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-76aa5885-599e-4edd-9cad-e8381cc83d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.158134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:41.175353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa5885-599e-4edd-9cad-e8381cc83d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.176838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa5885-599e-4edd-9cad-e8381cc83d06 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.180907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484aa17-ce2a-4f35-9114-8b1c86ed9c0d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.187097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.188112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.188395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.188755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] PATH_INFO: `/v3/projects/bdb55dd6d2604245afffbc3ff176e327` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.189391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1066/2123] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:41.190123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb55dd6d2604245afffbc3ff176e327)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.192223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.251623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb55dd6d2604245afffbc3ff176e327', 'request_id': 'req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.261304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb55dd6d2604245afffbc3ff176e327', 'request_id': 'req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.271067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb55dd6d2604245afffbc3ff176e327', 'request_id': 'req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.287467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] The token cache is being invalidate because project bdb55dd6d2604245afffbc3ff176e327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:41.287819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.288577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f9ac2d8d-b3da-4125-b0f2-12395a3bc59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.291057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1058/2124] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:41 2022] DELETE /identity/v3/projects/bdb55dd6d2604245afffbc3ff176e327 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:41.296474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.296771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.297061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.321215 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:41.322501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.385749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1067/2125] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:41.397675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70a0f-6f74-4f9c-ae6f-b8c7311b9af8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.398180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70a0f-6f74-4f9c-ae6f-b8c7311b9af8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.398305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70a0f-6f74-4f9c-ae6f-b8c7311b9af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.416106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.417743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.422046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a5f70a0f-6f74-4f9c-ae6f-b8c7311b9af8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:41.423274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a5f70a0f-6f74-4f9c-ae6f-b8c7311b9af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.430558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7a99c-7abe-4c8f-89ec-408f8626d794 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.431444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1059/2126] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:41.435518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f70a0f-6f74-4f9c-ae6f-b8c7311b9af8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.435927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.436837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.437158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.437439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] PATH_INFO: `/v3/users/0766c0a3016849c59c6c3d1613de5e5c` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.438718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0766c0a3016849c59c6c3d1613de5e5c)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.441153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.444510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f70a0f-6f74-4f9c-ae6f-b8c7311b9af8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.449708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.450405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.450664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.450942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.451728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:41.452118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.453868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.468647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1060/2127] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:47:41.473270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.484269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173af3c-33e7-41cb-b842-c40ec38614ce admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.492402 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.493276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.493660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.494036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.494865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.496849 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.498276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0766c0a3016849c59c6c3d1613de5e5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.514280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0766c0a3016849c59c6c3d1613de5e5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.515282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0766c0a3016849c59c6c3d1613de5e5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.528665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0766c0a3016849c59c6c3d1613de5e5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.532751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1061/2128] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:41 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:41.533752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.536269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.541558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a88fa34c-2266-489d-9cfe-d4c10b0c36c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0766c0a3016849c59c6c3d1613de5e5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:41.548317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1068/2129] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:41 2022] DELETE /identity/v3/users/0766c0a3016849c59c6c3d1613de5e5c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:41.553205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.554148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.555033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.574957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:41.577141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:41.579253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.619491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e506-12af-43d5-973e-6af551aba804 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.646865 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1069/2130] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:41.657511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.658916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.668368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:41.687918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.688593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.688882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.689157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.689843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.692140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.719274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1062/2131] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:41 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:41.719274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.728548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c881e2-942f-49d5-a2e1-b55acd7b3805 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.730859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31624e90-fab4-4356-b01a-5dd43969758b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.733327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.733986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.734273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.734501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.734639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.735140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.735279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.735457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.735739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.736875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.744733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.746672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.748107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1063/2132] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:41.752018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.756791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1070/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:41.761379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e38c7-c302-447e-acbf-8d9f6ab09670 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.766624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534a4f-b9a9-455c-b434-dbe8c61c6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.767312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534a4f-b9a9-455c-b434-dbe8c61c6314 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.767601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534a4f-b9a9-455c-b434-dbe8c61c6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.767884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534a4f-b9a9-455c-b434-dbe8c61c6314 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.768600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534a4f-b9a9-455c-b434-dbe8c61c6314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.770193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534a4f-b9a9-455c-b434-dbe8c61c6314 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.781288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1064/2134] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:41.785493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.795753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2a8b5-cd01-4bdb-bbe8-4b0bf55b765b service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:41.801127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:41.802043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.802328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.802608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] PATH_INFO: `/v3/projects/3cfafd9a9cfc4531913c272659995fb0/users/016cf546deea4dbfaa2244039430d0d5/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.819071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfafd9a9cfc4531913c272659995fb0, user_id=016cf546deea4dbfaa2244039430d0d5, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:41.821867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:41.836486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1071/2135] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:41 2022] PUT /identity/v3/projects/3cfafd9a9cfc4531913c272659995fb0/users/016cf546deea4dbfaa2244039430d0d5/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:41.841931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:41.842339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:41.842719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:41.861596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:41.862879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:41.958644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1065/2136] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:41.967911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:41.969874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:42.047350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa0864-1784-4141-90a6-d7ec86b03d21 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:42.052751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:42.053848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:42.054361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:42.055002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:42.067583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:42.069839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:42.087266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:42.090662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:42.094928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65e35c-80d5-4feb-97a8-ecbb756f2196 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:42.102641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:42.104606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:42.105212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:42.106504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] PATH_INFO: `/v3/projects/738a16d200974ede8b399cc7f35b5b49` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:42.109380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738a16d200974ede8b399cc7f35b5b49)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:42.109602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1072/2137] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:42.111582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:42.156583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:42.165790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738a16d200974ede8b399cc7f35b5b49', 'request_id': 'req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.172581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738a16d200974ede8b399cc7f35b5b49', 'request_id': 'req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.180152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738a16d200974ede8b399cc7f35b5b49', 'request_id': 'req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.192051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] The token cache is being invalidate because project 738a16d200974ede8b399cc7f35b5b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:42.192349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.193069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.194804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1066/2138] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:42 2022] DELETE /identity/v3/projects/738a16d200974ede8b399cc7f35b5b49 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:42.198959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:42.218828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fed5d-adce-4adf-ae49-3d480322aa73 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:42.281355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:42.282279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:42.282645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:42.282903 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] PATH_INFO: `/v3/users/9ea886eda4a742beab8bfc0377ff7781` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:42.284256 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea886eda4a742beab8bfc0377ff7781)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:42.286227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:42.320122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:42.344054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea886eda4a742beab8bfc0377ff7781'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.358063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea886eda4a742beab8bfc0377ff7781'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.358824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea886eda4a742beab8bfc0377ff7781'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.370827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea886eda4a742beab8bfc0377ff7781'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.380016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9282465e-7920-45a6-bf8b-39f71a187551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea886eda4a742beab8bfc0377ff7781'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:42.388514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1073/2139] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:42 2022] DELETE /identity/v3/users/9ea886eda4a742beab8bfc0377ff7781 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:42.978672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:42.980413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:42.993823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5534b2-9d2e-4b7f-b8fb-36cab28d4ab9 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.076777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.077403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.077841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.082858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.083748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.084039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.084320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] PATH_INFO: `/v3/projects/c5f79fdc0d494cdea5b4fde70e0b1322` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.085661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f79fdc0d494cdea5b4fde70e0b1322)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.087685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.111830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] MFA Rules not processed for user `016cf546deea4dbfaa2244039430d0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:43.114561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.173237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f79fdc0d494cdea5b4fde70e0b1322', 'request_id': 'req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.180492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f79fdc0d494cdea5b4fde70e0b1322', 'request_id': 'req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.190798 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f79fdc0d494cdea5b4fde70e0b1322', 'request_id': 'req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.198929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1074/2140] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:43.200507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.201844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.206204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] The token cache is being invalidate because project c5f79fdc0d494cdea5b4fde70e0b1322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:43.206566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.207286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.209193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1067/2141] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:42 2022] DELETE /identity/v3/projects/c5f79fdc0d494cdea5b4fde70e0b1322 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:43.212314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.216386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.221656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad795a-c314-488f-afaa-e53dc1429077 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.286020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:43.290277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.290539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457d803-14ea-40ff-9ec8-1b0c7b232ce6 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.291394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.291671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.292107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] PATH_INFO: `/v3/users/156969e91c2041d39ce5a779684e43d9` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.293214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=156969e91c2041d39ce5a779684e43d9)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.295415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.297051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02172e-f96c-40a4-8e9e-e7efd8b7a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.297796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02172e-f96c-40a4-8e9e-e7efd8b7a2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.298372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02172e-f96c-40a4-8e9e-e7efd8b7a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.299019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02172e-f96c-40a4-8e9e-e7efd8b7a2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.299865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02172e-f96c-40a4-8e9e-e7efd8b7a2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.302510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02172e-f96c-40a4-8e9e-e7efd8b7a2b2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.335882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1068/2142] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:43.337294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820027-3aad-4beb-9c39-d6121a5d6b25 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.337789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820027-3aad-4beb-9c39-d6121a5d6b25 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.338069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820027-3aad-4beb-9c39-d6121a5d6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.341241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:43.353923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156969e91c2041d39ce5a779684e43d9'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.356318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1a820027-3aad-4beb-9c39-d6121a5d6b25 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:43.357537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1a820027-3aad-4beb-9c39-d6121a5d6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.367345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156969e91c2041d39ce5a779684e43d9'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.368085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156969e91c2041d39ce5a779684e43d9'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.376848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156969e91c2041d39ce5a779684e43d9'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.384300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156969e91c2041d39ce5a779684e43d9'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:43.391833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1075/2143] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:43 2022] DELETE /identity/v3/users/156969e91c2041d39ce5a779684e43d9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:43.392696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.394006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.422902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1069/2144] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:43.424524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595cf3-5419-4f7a-8954-e2137b5ec21c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.424926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595cf3-5419-4f7a-8954-e2137b5ec21c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.425129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595cf3-5419-4f7a-8954-e2137b5ec21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.452412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-fe595cf3-5419-4f7a-8954-e2137b5ec21c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:43.453695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fe595cf3-5419-4f7a-8954-e2137b5ec21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.469179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc848f5-0189-46d9-ad85-751554c005a5 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.474233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc391f3a-0374-4e55-a1cd-fd4497f515af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.474908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc391f3a-0374-4e55-a1cd-fd4497f515af admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.475191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc391f3a-0374-4e55-a1cd-fd4497f515af admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.475492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc391f3a-0374-4e55-a1cd-fd4497f515af admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.476175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc391f3a-0374-4e55-a1cd-fd4497f515af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.478147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc391f3a-0374-4e55-a1cd-fd4497f515af admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.502673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1076/2145] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/users => generated 309 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:43.504017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ffb70-38f9-4f97-8468-f06c155172d1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.504309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ffb70-38f9-4f97-8468-f06c155172d1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.504704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ffb70-38f9-4f97-8468-f06c155172d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.522854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8b1ffb70-38f9-4f97-8468-f06c155172d1 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:43.524093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8b1ffb70-38f9-4f97-8468-f06c155172d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.531071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1070/2146] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:43.531961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe595cf3-5419-4f7a-8954-e2137b5ec21c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.532593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1077/2147] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:43.536308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ffb70-38f9-4f97-8468-f06c155172d1 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.546852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ffb70-38f9-4f97-8468-f06c155172d1 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.549554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe595cf3-5419-4f7a-8954-e2137b5ec21c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.551526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.552187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.552602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.552926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.553644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:43.553952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.554249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.554915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.555215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.555511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.555602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.556242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.557842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.570968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1071/2148] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:43.571142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1078/2149] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:47:43.571321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.571321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:43.572181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.581875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c98a-02a1-4dc9-ae18-e137e848400c admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.586561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.587252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.587570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.587850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.588527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.590977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.617033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1079/2150] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:43.620337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.628938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd1f8b-45bc-4ac7-be6b-8e3c9fd75034 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.656821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:43.680543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.681197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.681483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.681796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.694408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82671c36-e530-41ab-84d7-72dcd0fe4c01 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.696492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.697946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.699734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.700757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.701235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.701521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] PATH_INFO: `/v3/projects/51c28cd7927b48bda48c4377f8b0a479/users/41599ddff42f4891bd3ee49888a8b62d/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.706850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:43.709580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1072/2151] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:43.710548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.721438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1052-8a9d-412f-b090-f681ec0b0e84 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.724489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c28cd7927b48bda48c4377f8b0a479, user_id=41599ddff42f4891bd3ee49888a8b62d, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.726854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.727787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.728071 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.728507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.728941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.729817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.732275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.749266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1080/2152] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:43 2022] PUT /identity/v3/projects/51c28cd7927b48bda48c4377f8b0a479/users/41599ddff42f4891bd3ee49888a8b62d/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:43.753738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.766924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1073/2153] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:43 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:43.768150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.780351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79479-b7c6-4d1c-9398-bc763d025c35 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.831597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d3aa4-51bb-461f-bfde-a5cca2d4fb9e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.837602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.838220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.838513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.838930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.840607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.842278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.867723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1081/2154] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:43.868255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.868255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.868255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.868255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.868854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.868854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.869048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.882902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc631d37-c48f-42fa-9be4-3df9e5371108 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:43.890641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:43.892206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:43.892889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:43.893538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] PATH_INFO: `/v3/projects/51c28cd7927b48bda48c4377f8b0a479/users/41599ddff42f4891bd3ee49888a8b62d/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:43.896054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c28cd7927b48bda48c4377f8b0a479, user_id=41599ddff42f4891bd3ee49888a8b62d, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:43.900423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:43.904906 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1074/2155] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:43.909064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:43.920635 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1082/2156] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:43 2022] PUT /identity/v3/projects/51c28cd7927b48bda48c4377f8b0a479/users/41599ddff42f4891bd3ee49888a8b62d/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:43.935236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998a2c9-54e6-4c8b-83c0-2fc0ea513c2a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.031028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eaf4a-b1e0-4b82-99d8-820af7f4116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.032741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eaf4a-b1e0-4b82-99d8-820af7f4116e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.033137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eaf4a-b1e0-4b82-99d8-820af7f4116e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.033446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eaf4a-b1e0-4b82-99d8-820af7f4116e admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.034183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eaf4a-b1e0-4b82-99d8-820af7f4116e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.036494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eaf4a-b1e0-4b82-99d8-820af7f4116e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.049572 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1075/2157] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:44.053643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.068508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b2a3-781b-4f71-912f-7a0b206ba02b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.085803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.087286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.087888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.088314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] PATH_INFO: `/v3/projects/c3c897ec995e4acd825d016cc391fa02/users/e550991c7d684f20919e74a619fe60cb/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.108511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c897ec995e4acd825d016cc391fa02, user_id=e550991c7d684f20919e74a619fe60cb, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.111304 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.129140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1083/2158] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:44 2022] PUT /identity/v3/projects/c3c897ec995e4acd825d016cc391fa02/users/e550991c7d684f20919e74a619fe60cb/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:44.140197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870160-e6f9-4c77-98a8-cfa7a1e8df46 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.140487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870160-e6f9-4c77-98a8-cfa7a1e8df46 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.140831 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870160-e6f9-4c77-98a8-cfa7a1e8df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.173373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-88870160-e6f9-4c77-98a8-cfa7a1e8df46 None None] MFA Rules not processed for user `e550991c7d684f20919e74a619fe60cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:44.174660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-88870160-e6f9-4c77-98a8-cfa7a1e8df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:44.213990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.216656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:44.232091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:44.310682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1076/2159] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:44.312453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88870160-e6f9-4c77-98a8-cfa7a1e8df46 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.334338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a012-1f61-48b3-ba61-f241ef7725a8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.340749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.341677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.342034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.342380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] PATH_INFO: `/v3/projects/8705f6b6c3434e42976560fd1087ae3b` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.343833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8705f6b6c3434e42976560fd1087ae3b)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.346344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.399954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88870160-e6f9-4c77-98a8-cfa7a1e8df46 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.405732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:44.412113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8705f6b6c3434e42976560fd1087ae3b', 'request_id': 'req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:44.421706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8705f6b6c3434e42976560fd1087ae3b', 'request_id': 'req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:44.430703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8705f6b6c3434e42976560fd1087ae3b', 'request_id': 'req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:44.449093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] The token cache is being invalidate because project 8705f6b6c3434e42976560fd1087ae3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:44.449434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:44.450193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:44.452462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1084/2160] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:44 2022] DELETE /identity/v3/projects/8705f6b6c3434e42976560fd1087ae3b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:44.474254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.475083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.475400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.475700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.476438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.478700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.519679 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1077/2161] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:44 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:44.524298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.530067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:44.545883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a4b7c-353c-4905-8d93-ecc1b2acf25a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.619410 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.620346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.620656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.621021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.622502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.624770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.655069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1085/2162] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:44 2022] POST /identity/v3/users => generated 297 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:44.659470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.670455 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a648f2-4efe-401d-81fb-669725805244 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.675329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.676287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.676579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.677002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.677763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.679475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.694629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1078/2163] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:44.696453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.710885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434cc4e-6942-469a-9c3c-bc2b31ecaf14 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.716592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.717479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.717768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.718050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] PATH_INFO: `/v3/projects/e0621a81b45544fd82b741dc89c75363/users/9a07edf491bf4aeba40155c1be350060/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.735685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0621a81b45544fd82b741dc89c75363, user_id=9a07edf491bf4aeba40155c1be350060, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.738372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.752716 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1086/2164] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:44 2022] PUT /identity/v3/projects/e0621a81b45544fd82b741dc89c75363/users/9a07edf491bf4aeba40155c1be350060/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:44.762183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.772109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909036-e9f3-47c2-80fa-ea3f03ea0fd1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.828226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:44.835845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b807f0-e559-4f51-8382-1b35cda2446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.836544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b807f0-e559-4f51-8382-1b35cda2446d admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.836959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b807f0-e559-4f51-8382-1b35cda2446d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.837248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b807f0-e559-4f51-8382-1b35cda2446d admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.837991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b807f0-e559-4f51-8382-1b35cda2446d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.840378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b807f0-e559-4f51-8382-1b35cda2446d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.850902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1079/2165] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:44.857059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:44.867407 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49cd6a-eb52-4547-a766-6d288d10e907 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:44.872518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dfd4e-9027-4105-950e-6a462ea666b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:44.873482 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dfd4e-9027-4105-950e-6a462ea666b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.873833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dfd4e-9027-4105-950e-6a462ea666b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.874200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dfd4e-9027-4105-950e-6a462ea666b0 admin admin] PATH_INFO: `/v3/projects/e0621a81b45544fd82b741dc89c75363/users/9a07edf491bf4aeba40155c1be350060/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.876271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dfd4e-9027-4105-950e-6a462ea666b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0621a81b45544fd82b741dc89c75363, user_id=9a07edf491bf4aeba40155c1be350060, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:44.878965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dfd4e-9027-4105-950e-6a462ea666b0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:44.891586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1087/2166] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:44 2022] PUT /identity/v3/projects/e0621a81b45544fd82b741dc89c75363/users/9a07edf491bf4aeba40155c1be350060/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:44.903051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.903412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.903696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.942910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:44.943194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:44.943498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:44.958650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] MFA Rules not processed for user `9a07edf491bf4aeba40155c1be350060`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:44.960155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:44.972812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] MFA Rules not processed for user `41599ddff42f4891bd3ee49888a8b62d`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:44.974694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:45.069636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1088/2167] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:45.074762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1080/2168] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:45.082547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:45.084105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:45.103389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:45.161735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1dd30-6adc-49ca-94c1-1ea5073814c3 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:45.166904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e87da-69ea-45bf-9bfe-b60c8aa10894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:45.168302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e87da-69ea-45bf-9bfe-b60c8aa10894 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:45.168623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e87da-69ea-45bf-9bfe-b60c8aa10894 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:45.168878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e87da-69ea-45bf-9bfe-b60c8aa10894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:45.181516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e87da-69ea-45bf-9bfe-b60c8aa10894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:45.183280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e87da-69ea-45bf-9bfe-b60c8aa10894 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:45.194358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1089/2169] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:45.395078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:45.396582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:45.499373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4daec-a95c-4582-82b3-d9df403327c3 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:45.509095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:45.509986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:45.510269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:45.510550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] PATH_INFO: `/v3/users/3eeef152335e458a9ffdc45eb8ee1653` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:45.512637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eeef152335e458a9ffdc45eb8ee1653)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:45.515156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:45.580727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eeef152335e458a9ffdc45eb8ee1653'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.595932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eeef152335e458a9ffdc45eb8ee1653'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.613509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eeef152335e458a9ffdc45eb8ee1653'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.625371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eeef152335e458a9ffdc45eb8ee1653'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.626202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eeef152335e458a9ffdc45eb8ee1653'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.631562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:45.642328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1081/2170] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:45 2022] DELETE /identity/v3/users/3eeef152335e458a9ffdc45eb8ee1653 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:45.648278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:45.648682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:45.649497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:45.655024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:45.656873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:45.672344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:45.673855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:45.757850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef0ebf-de31-4790-9867-6c85a6b127f8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:45.760930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1090/2171] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:45.767216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:45.768400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:45.768785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:45.769188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] PATH_INFO: `/v3/users/e550991c7d684f20919e74a619fe60cb` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:45.771225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e550991c7d684f20919e74a619fe60cb)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:45.772798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:45.774358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:45.777626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:45.839300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71bf45-d13f-4b22-a07f-1db0675eacff None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:45.841697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e550991c7d684f20919e74a619fe60cb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.843278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d0cb2-5d54-4e3f-8256-e5257e6d3777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:45.844004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0cb2-5d54-4e3f-8256-e5257e6d3777 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:45.844370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0cb2-5d54-4e3f-8256-e5257e6d3777 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:45.844718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0cb2-5d54-4e3f-8256-e5257e6d3777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:45.855995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d0cb2-5d54-4e3f-8256-e5257e6d3777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:45.856778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e550991c7d684f20919e74a619fe60cb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.857808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d0cb2-5d54-4e3f-8256-e5257e6d3777 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:45.866325 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e550991c7d684f20919e74a619fe60cb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.876532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e550991c7d684f20919e74a619fe60cb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.877324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e550991c7d684f20919e74a619fe60cb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:45.882279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1091/2172] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:45.887737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1082/2173] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:45 2022] DELETE /identity/v3/users/e550991c7d684f20919e74a619fe60cb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:45.894316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:45.894681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:45.895058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:45.914297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:45.915698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:45.986521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:45.998894 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1092/2174] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:46.009637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:46.011090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:46.070379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c32b41-f3bc-4cd1-a3e6-e633d09ab7ef admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:46.074666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:46.075348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:46.075875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:46.075974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:46.085040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:46.086469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:46.097165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1083/2175] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:46.351520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:46.353941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:46.358375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:46.359175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:46.378815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030c8f4-b69f-4796-a5fd-308b9753750e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:46.379002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f90a2-6fc3-4d84-bdf1-091ea039c51f service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:46.384972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:46.385140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:46.385847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:46.386129 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:46.386400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] PATH_INFO: `/v3/projects/6edd725e6f104dafb3dd13617d245749` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:46.387264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:46.387653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:46.388026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] PATH_INFO: `/v3/users/016cf546deea4dbfaa2244039430d0d5` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:46.388334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edd725e6f104dafb3dd13617d245749)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:46.389428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=016cf546deea4dbfaa2244039430d0d5)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:46.390406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:46.391626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:46.427306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:46.467121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016cf546deea4dbfaa2244039430d0d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.469824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edd725e6f104dafb3dd13617d245749', 'request_id': 'req-e2dfacb9-20ce-4a31-b917-463053a7fabc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.476256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edd725e6f104dafb3dd13617d245749', 'request_id': 'req-e2dfacb9-20ce-4a31-b917-463053a7fabc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.485795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edd725e6f104dafb3dd13617d245749', 'request_id': 'req-e2dfacb9-20ce-4a31-b917-463053a7fabc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.495218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016cf546deea4dbfaa2244039430d0d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.496874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016cf546deea4dbfaa2244039430d0d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.499525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] The token cache is being invalidate because project 6edd725e6f104dafb3dd13617d245749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:46.499923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.500738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.502462 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1084/2176] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:46 2022] DELETE /identity/v3/projects/6edd725e6f104dafb3dd13617d245749 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:46.506497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:46.507859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:46.510015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016cf546deea4dbfaa2244039430d0d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.523703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016cf546deea4dbfaa2244039430d0d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.531870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1093/2177] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:46 2022] DELETE /identity/v3/users/016cf546deea4dbfaa2244039430d0d5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:46.532949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:46.534549 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:46.587474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfacb9-20ce-4a31-b917-463053a7fabc admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:46.626642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25f2d0-cc10-49f5-baf1-b607365718fe admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:46.631689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:46.632447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:46.632745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:46.634280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] PATH_INFO: `/v3/projects/c3c897ec995e4acd825d016cc391fa02` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:46.634424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c897ec995e4acd825d016cc391fa02)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:46.636276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:46.666567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:46.670583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:46.670583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:46.670583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] PATH_INFO: `/v3/users/bc72b728c2ac4d71b625d3e7213d17f9` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:46.670583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc72b728c2ac4d71b625d3e7213d17f9)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:46.673385 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:46.696336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c897ec995e4acd825d016cc391fa02', 'request_id': 'req-e4078102-d8eb-4811-ae09-75e72b4ac6c3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.705636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c897ec995e4acd825d016cc391fa02', 'request_id': 'req-e4078102-d8eb-4811-ae09-75e72b4ac6c3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.715897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c897ec995e4acd825d016cc391fa02', 'request_id': 'req-e4078102-d8eb-4811-ae09-75e72b4ac6c3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.726681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:46.731939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] The token cache is being invalidate because project c3c897ec995e4acd825d016cc391fa02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:46.732236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.733077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.736394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1094/2178] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:46 2022] DELETE /identity/v3/projects/c3c897ec995e4acd825d016cc391fa02 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:46.740610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:46.742160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:46.744902 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc72b728c2ac4d71b625d3e7213d17f9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.751743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:46.763847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc72b728c2ac4d71b625d3e7213d17f9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.773055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc72b728c2ac4d71b625d3e7213d17f9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.791358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc72b728c2ac4d71b625d3e7213d17f9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.797787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc72b728c2ac4d71b625d3e7213d17f9'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:46.814430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1085/2179] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:46 2022] DELETE /identity/v3/users/bc72b728c2ac4d71b625d3e7213d17f9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:46.846253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4078102-d8eb-4811-ae09-75e72b4ac6c3 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:46.863695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:46.866133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:46.936911 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:46.937799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:46.938152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:46.938356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] PATH_INFO: `/v3/users/9a07edf491bf4aeba40155c1be350060` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:46.940032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a07edf491bf4aeba40155c1be350060)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:46.942488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:46.965588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3655-d844-4fd6-b7d6-0af3413f22f8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:46.973107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:46.974087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:46.974439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:46.974793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] PATH_INFO: `/v3/projects/3cfafd9a9cfc4531913c272659995fb0` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:46.976486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfafd9a9cfc4531913c272659995fb0)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:46.978796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:47.006672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a07edf491bf4aeba40155c1be350060'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.024706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a07edf491bf4aeba40155c1be350060'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.025458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a07edf491bf4aeba40155c1be350060'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.034086 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a07edf491bf4aeba40155c1be350060'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.041113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfafd9a9cfc4531913c272659995fb0', 'request_id': 'req-d81929ae-f32d-456e-8c2d-0f19af87402f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.041906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a07edf491bf4aeba40155c1be350060'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.048278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfafd9a9cfc4531913c272659995fb0', 'request_id': 'req-d81929ae-f32d-456e-8c2d-0f19af87402f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.049083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1095/2180] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:46 2022] DELETE /identity/v3/users/9a07edf491bf4aeba40155c1be350060 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:47.056481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfafd9a9cfc4531913c272659995fb0', 'request_id': 'req-d81929ae-f32d-456e-8c2d-0f19af87402f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.075552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] The token cache is being invalidate because project 3cfafd9a9cfc4531913c272659995fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:47.076140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.076774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.081892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1086/2181] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:46 2022] DELETE /identity/v3/projects/3cfafd9a9cfc4531913c272659995fb0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:47.083300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:47.085500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.124719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:47.166000 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:47.168245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.174812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd7eb6-337e-44bd-860a-1564b3a4c04f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:47.180961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:47.181991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.182361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.182772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] PATH_INFO: `/v3/users/41599ddff42f4891bd3ee49888a8b62d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.185219 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] RBAC: Authorizing `identity:delete_user(user_id=41599ddff42f4891bd3ee49888a8b62d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:47.187693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:47.249245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81929ae-f32d-456e-8c2d-0f19af87402f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:47.257142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41599ddff42f4891bd3ee49888a8b62d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.271471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:47.271934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41599ddff42f4891bd3ee49888a8b62d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.272826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.273059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.273972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] PATH_INFO: `/v3/projects/e07753de829a4a7d9624d9620cd18feb` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.274300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41599ddff42f4891bd3ee49888a8b62d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.275235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07753de829a4a7d9624d9620cd18feb)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:47.285389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:47.287598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:47.289859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41599ddff42f4891bd3ee49888a8b62d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.305957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41599ddff42f4891bd3ee49888a8b62d'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.313597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1096/2182] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:47 2022] DELETE /identity/v3/users/41599ddff42f4891bd3ee49888a8b62d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:47.361228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07753de829a4a7d9624d9620cd18feb', 'request_id': 'req-136227dd-b5ab-4da0-b74b-fccea9a629af'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.375083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07753de829a4a7d9624d9620cd18feb', 'request_id': 'req-136227dd-b5ab-4da0-b74b-fccea9a629af'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.388663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07753de829a4a7d9624d9620cd18feb', 'request_id': 'req-136227dd-b5ab-4da0-b74b-fccea9a629af'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.423751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] The token cache is being invalidate because project e07753de829a4a7d9624d9620cd18feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:47.426930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.426930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.428720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:47.430208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.431957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1087/2183] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:47 2022] DELETE /identity/v3/projects/e07753de829a4a7d9624d9620cd18feb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:47.436406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:47.437872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.527121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732e96-6c3e-4944-96e2-4d024558032a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:47.559274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136227dd-b5ab-4da0-b74b-fccea9a629af admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:47.567731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:47.568688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.569095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.569396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] PATH_INFO: `/v3/users/6ad1c2defdc544bf8ba53b7e47862dbb` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.570737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad1c2defdc544bf8ba53b7e47862dbb)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:47.572729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:47.589123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:47.602153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:47.603094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.603449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.603732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] PATH_INFO: `/v3/projects/e0621a81b45544fd82b741dc89c75363` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.605051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0621a81b45544fd82b741dc89c75363)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:47.607642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:47.642254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad1c2defdc544bf8ba53b7e47862dbb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.657589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad1c2defdc544bf8ba53b7e47862dbb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.664570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad1c2defdc544bf8ba53b7e47862dbb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.672024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0621a81b45544fd82b741dc89c75363', 'request_id': 'req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.677331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad1c2defdc544bf8ba53b7e47862dbb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.678066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad1c2defdc544bf8ba53b7e47862dbb'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.680241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0621a81b45544fd82b741dc89c75363', 'request_id': 'req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.687005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1088/2184] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:47 2022] DELETE /identity/v3/users/6ad1c2defdc544bf8ba53b7e47862dbb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:47.688232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:47.688768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0621a81b45544fd82b741dc89c75363', 'request_id': 'req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.690076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.705502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:47.709896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] The token cache is being invalidate because project e0621a81b45544fd82b741dc89c75363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:47.710432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.711671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b0ace9b2-178c-45e6-a5bd-dade5c46ac24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.713789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1097/2185] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:47 2022] DELETE /identity/v3/projects/e0621a81b45544fd82b741dc89c75363 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:47.719523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc308-c387-47f8-9500-09b15ad21b50 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.720206 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc308-c387-47f8-9500-09b15ad21b50 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.720530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc308-c387-47f8-9500-09b15ad21b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.742507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-670fc308-c387-47f8-9500-09b15ad21b50 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:47.743891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-670fc308-c387-47f8-9500-09b15ad21b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.775656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a34960-e021-4105-b8bd-20d960ebe4a9 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:47.782159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:47.783028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.783405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.783774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] PATH_INFO: `/v3/projects/51c28cd7927b48bda48c4377f8b0a479` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.792307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c28cd7927b48bda48c4377f8b0a479)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:47.796447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:47.825991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1098/2186] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:47.827701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16e39e-0ae5-4215-b850-353882f5a05d None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.827998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16e39e-0ae5-4215-b850-353882f5a05d None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.828282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16e39e-0ae5-4215-b850-353882f5a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.849701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-bb16e39e-0ae5-4215-b850-353882f5a05d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:47.851372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bb16e39e-0ae5-4215-b850-353882f5a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.868351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c28cd7927b48bda48c4377f8b0a479', 'request_id': 'req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.878586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c28cd7927b48bda48c4377f8b0a479', 'request_id': 'req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.888698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c28cd7927b48bda48c4377f8b0a479', 'request_id': 'req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.913606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] The token cache is being invalidate because project 51c28cd7927b48bda48c4377f8b0a479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:47.914085 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.914920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8ab2f272-d57a-4af9-8a1a-5dc9bd6f572c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:47.921388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1089/2187] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:47 2022] DELETE /identity/v3/projects/51c28cd7927b48bda48c4377f8b0a479 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:47.923885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1485d-2b1e-435c-8332-9b2794972e99 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.924241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1485d-2b1e-435c-8332-9b2794972e99 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.924583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1485d-2b1e-435c-8332-9b2794972e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.941378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1099/2188] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:47.944207 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-76f1485d-2b1e-435c-8332-9b2794972e99 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:47.945527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-76f1485d-2b1e-435c-8332-9b2794972e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.945671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16e39e-0ae5-4215-b850-353882f5a05d None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:47.955176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1090/2189] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:47.955374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16e39e-0ae5-4215-b850-353882f5a05d None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:47.959986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:47.960653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.960940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.961509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.962101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:47.962419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:47.962914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a83a7-d370-494f-ac67-34119dae5595 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:47.963224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a83a7-d370-494f-ac67-34119dae5595 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:47.963542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a83a7-d370-494f-ac67-34119dae5595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:47.964068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:47.977950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1100/2190] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:47:47.982882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:47.983234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-217a83a7-d370-494f-ac67-34119dae5595 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:47.984471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-217a83a7-d370-494f-ac67-34119dae5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:47.992916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1091/2191] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:47.993469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a51ec-4459-4a59-84a9-c563c585a747 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:47.997499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a83a7-d370-494f-ac67-34119dae5595 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.000097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.000867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.001257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.001660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.002462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.004893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.007375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a83a7-d370-494f-ac67-34119dae5595 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.014147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.014837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.015128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.015446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.016193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:48.016512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.018130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.021411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:48.039445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1092/2192] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:48.041763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.052852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe65d9-0d7f-4bfb-b203-3bd5a4140432 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.059066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1101/2193] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:47 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:48.060154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.151036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.151968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.152994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.153273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.153375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773bbe8-569a-4693-b9ac-647d2a20cd3d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.153978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.155923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.158255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.158931 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.159245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.159523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.160342 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.162425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.181741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:48.191586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1102/2194] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:48.195157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1093/2195] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:48.196063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.196575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.209194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca363a-2bda-4b62-9d93-2a636fe47215 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.265967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972e88a-e3c6-46c9-8b31-eeefbc58eaa0 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.272932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.273713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.274070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.274417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.275173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.277233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.304324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.305011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.305335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.305566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.306325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.307978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.312639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1094/2196] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:48.312639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.314497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.320559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1103/2197] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:48.321285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.335257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf3baa-bb2c-427f-b614-d5bdc11c9614 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.340493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.341258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.341617 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.341974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.342816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.343015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9178d-4199-4e2e-a90c-6ae7c9e736ef admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.344644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.348434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.349333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.349647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.349924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] PATH_INFO: `/v3/projects/03cab30c91574146ad5d3c89ab688008` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.351107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cab30c91574146ad5d3c89ab688008)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.353105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.356029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1104/2198] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:48.356669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.366004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42fc0-a5e8-4933-9a5f-4218973968a5 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.370619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.371870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.372160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.372447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.373153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.374719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.387246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1105/2199] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:48.387246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.397126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0b02-a903-43c4-81f7-149c30e54013 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.407645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cab30c91574146ad5d3c89ab688008', 'request_id': 'req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:48.418334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cab30c91574146ad5d3c89ab688008', 'request_id': 'req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:48.426869 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cab30c91574146ad5d3c89ab688008', 'request_id': 'req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:48.437698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] The token cache is being invalidate because project 03cab30c91574146ad5d3c89ab688008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:48.437986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:48.438645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:48.440221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1095/2200] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:48 2022] DELETE /identity/v3/projects/03cab30c91574146ad5d3c89ab688008 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:48.444316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.445783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.458972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:48.470366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6e3b-afb0-4c31-ba24-e9e92bc26f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.471091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6e3b-afb0-4c31-ba24-e9e92bc26f9b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.471519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6e3b-afb0-4c31-ba24-e9e92bc26f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.471807 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6e3b-afb0-4c31-ba24-e9e92bc26f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.472538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6e3b-afb0-4c31-ba24-e9e92bc26f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.474135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6e3b-afb0-4c31-ba24-e9e92bc26f9b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.485516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1106/2201] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:48.489062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.489354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.489639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.507604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:48.508799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.517262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1107/2202] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:48.517997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.519036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937d3c-0f87-41f5-8abb-ab60bb5d71fd admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.519253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.523939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f760852-f09c-46fb-ad18-d7597fad6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.524829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760852-f09c-46fb-ad18-d7597fad6f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.525121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760852-f09c-46fb-ad18-d7597fad6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.525398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760852-f09c-46fb-ad18-d7597fad6f6e admin admin] PATH_INFO: `/v3/projects/b8f7ca1f7a5d4049a13102ed00629c9a/users/df586c3b6e364acfa97537ad07f260a2/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.532098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ca20c-1028-4802-b069-d67aa1dd7920 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.536808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e7f50-9838-4b35-9b49-6e8d9e84efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.538322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e7f50-9838-4b35-9b49-6e8d9e84efea admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.538608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e7f50-9838-4b35-9b49-6e8d9e84efea admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.538889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e7f50-9838-4b35-9b49-6e8d9e84efea admin admin] PATH_INFO: `/v3/projects/05442a9d8aef417ea959bf42468e7d33/users/c1e2c4903b7c4c1f9f70c133011b871f/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.541138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f760852-f09c-46fb-ad18-d7597fad6f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f7ca1f7a5d4049a13102ed00629c9a, user_id=df586c3b6e364acfa97537ad07f260a2, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.544398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f760852-f09c-46fb-ad18-d7597fad6f6e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.546585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:48.554852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e7f50-9838-4b35-9b49-6e8d9e84efea admin admin] RBAC: Authorizing `identity:create_grant(project_id=05442a9d8aef417ea959bf42468e7d33, user_id=c1e2c4903b7c4c1f9f70c133011b871f, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.557806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e7f50-9838-4b35-9b49-6e8d9e84efea admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.569949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1096/2203] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:48 2022] PUT /identity/v3/projects/b8f7ca1f7a5d4049a13102ed00629c9a/users/df586c3b6e364acfa97537ad07f260a2/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:48.571826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011fc8-41b5-42c6-9917-8e3eade5d105 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.572292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011fc8-41b5-42c6-9917-8e3eade5d105 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.572588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011fc8-41b5-42c6-9917-8e3eade5d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.579743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1108/2204] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:48 2022] PUT /identity/v3/projects/05442a9d8aef417ea959bf42468e7d33/users/c1e2c4903b7c4c1f9f70c133011b871f/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:48.581021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d23e4-c334-4003-8790-aafd6be7cd9f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.581314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d23e4-c334-4003-8790-aafd6be7cd9f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.581601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d23e4-c334-4003-8790-aafd6be7cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.591101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-18011fc8-41b5-42c6-9917-8e3eade5d105 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:48.592351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-18011fc8-41b5-42c6-9917-8e3eade5d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.601868 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-570d23e4-c334-4003-8790-aafd6be7cd9f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:48.603058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-570d23e4-c334-4003-8790-aafd6be7cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.654793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1097/2205] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:48.656107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798095-2faf-4432-89c2-59c46ceab2f1 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.656401 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798095-2faf-4432-89c2-59c46ceab2f1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.656679 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798095-2faf-4432-89c2-59c46ceab2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.663047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1109/2206] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:48.667083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d23e4-c334-4003-8790-aafd6be7cd9f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.678627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d23e4-c334-4003-8790-aafd6be7cd9f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.683402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.684098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.684385 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.684669 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.685525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:48.685841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.686469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-73798095-2faf-4432-89c2-59c46ceab2f1 None None] MFA Rules not processed for user `c1e2c4903b7c4c1f9f70c133011b871f`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:48.687464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.687718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-73798095-2faf-4432-89c2-59c46ceab2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.699338 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1110/2207] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:48.700099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.701719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:48.755815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1098/2208] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:48.756636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73798095-2faf-4432-89c2-59c46ceab2f1 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.758786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cc27d-6670-42c4-af11-c5023bc5bc4a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.764321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.765111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.765480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.765929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.767629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73798095-2faf-4432-89c2-59c46ceab2f1 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.772858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.773673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.773973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.774262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.774962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.776196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.776982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.778210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.787898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1111/2209] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:48.788683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.799265 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84090c-0c49-4ee3-84b1-fd954d18cdb4 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.804487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.805545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.806207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.806653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.807758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.807884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1099/2210] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:48.809701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.811843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.841996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1112/2211] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:48.845900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.892107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:48.897428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45497c19-ec67-4070-b989-b8bf22a58885 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.904340 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:48.943503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b87a42-5be5-4ac3-8f37-8d4328b96362 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:48.950429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.951284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.951513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.951797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.952491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.954425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.982527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1113/2212] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/users => generated 303 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:48.982896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:48.982896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:48.982896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:48.983279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:48.988336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:48.989473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:48.992392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:48.996609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117bbf-784f-45af-b0e4-ecc41f628c0a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.002526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.003187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.003509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.003802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.004541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.006146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.015721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1100/2213] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:48 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:49.019345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.023369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1114/2214] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:49.025147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.030152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7d52-ecdd-4b59-a619-bbc0d40e7982 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.036760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.037097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65966709-c1ae-4ab8-8c45-b3ab077ca1b1 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.039239 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.040360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.041374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.042250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.043684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.043974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.044138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.044302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] PATH_INFO: `/v3/projects/f017f2cef0c74643b14fab6e2b4f9a49/users/738d4cdfdba74137b729167ff9853d9e/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.046967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.063628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f017f2cef0c74643b14fab6e2b4f9a49, user_id=738d4cdfdba74137b729167ff9853d9e, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.063818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1101/2215] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:49.063924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.065100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.077064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37757e21-b939-4255-ab8d-2da0b55bae01 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.084480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1115/2216] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:49 2022] PUT /identity/v3/projects/f017f2cef0c74643b14fab6e2b4f9a49/users/738d4cdfdba74137b729167ff9853d9e/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:49.088177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.172019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef54f3a-a96d-4596-b399-c1def3098c3f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.178657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.179375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.179712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.180089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.180948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.182841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.195989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1116/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:49.200992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.205178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.205995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.206623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.206623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.207654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.209409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.214465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135711c7-2361-417b-b35b-f2673cb5c269 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.221606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace3e8a-14a3-426b-b2f7-17453dbe6c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.223100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace3e8a-14a3-426b-b2f7-17453dbe6c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.223100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace3e8a-14a3-426b-b2f7-17453dbe6c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.223100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace3e8a-14a3-426b-b2f7-17453dbe6c57 admin admin] PATH_INFO: `/v3/projects/f017f2cef0c74643b14fab6e2b4f9a49/users/738d4cdfdba74137b729167ff9853d9e/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.223529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1102/2218] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:49.225331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace3e8a-14a3-426b-b2f7-17453dbe6c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f017f2cef0c74643b14fab6e2b4f9a49, user_id=738d4cdfdba74137b729167ff9853d9e, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.227274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.229131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace3e8a-14a3-426b-b2f7-17453dbe6c57 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.238581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f638-d749-41c2-8ba1-c333f2215e0f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.245442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1117/2219] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:49 2022] PUT /identity/v3/projects/f017f2cef0c74643b14fab6e2b4f9a49/users/738d4cdfdba74137b729167ff9853d9e/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:49.255905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.256200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.256479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.290248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] MFA Rules not processed for user `738d4cdfdba74137b729167ff9853d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:49.291433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:49.357167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b433c-7bc5-48de-a696-052140aea4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.358209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b433c-7bc5-48de-a696-052140aea4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.358567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b433c-7bc5-48de-a696-052140aea4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.358923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b433c-7bc5-48de-a696-052140aea4fd admin admin] PATH_INFO: `/v3/projects/92398b8afcfd4d3a82213c810dc960f5/users/b21417e297604817a4337de395ca5dbd/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.384871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b433c-7bc5-48de-a696-052140aea4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=92398b8afcfd4d3a82213c810dc960f5, user_id=b21417e297604817a4337de395ca5dbd, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.388598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b433c-7bc5-48de-a696-052140aea4fd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.393545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:49.418353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1103/2220] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:49 2022] PUT /identity/v3/projects/92398b8afcfd4d3a82213c810dc960f5/users/b21417e297604817a4337de395ca5dbd/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:49.428579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ee5f1-f6a5-4e8b-be47-a65454f6dea7 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.428897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ee5f1-f6a5-4e8b-be47-a65454f6dea7 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.429148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ee5f1-f6a5-4e8b-be47-a65454f6dea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.439066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1118/2221] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:49.449916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:49.451111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.453047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:49.468781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-645ee5f1-f6a5-4e8b-be47-a65454f6dea7 None None] MFA Rules not processed for user `b21417e297604817a4337de395ca5dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:49.470635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-645ee5f1-f6a5-4e8b-be47-a65454f6dea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:49.527259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2f05-be9a-4f65-ab1d-17eba5d52e8f None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.564119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1104/2222] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:49.569488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ee5f1-f6a5-4e8b-be47-a65454f6dea7 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.606796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.607492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.607778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.608059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.654753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ee5f1-f6a5-4e8b-be47-a65454f6dea7 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.659411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2e18-67a3-4571-ab30-4a6c6d5ce65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.660074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2e18-67a3-4571-ab30-4a6c6d5ce65f admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.660359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2e18-67a3-4571-ab30-4a6c6d5ce65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.660637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2e18-67a3-4571-ab30-4a6c6d5ce65f admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.661333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da2e18-67a3-4571-ab30-4a6c6d5ce65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.663291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da2e18-67a3-4571-ab30-4a6c6d5ce65f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.692057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1105/2223] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:49 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:49.693964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.694387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.694822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.699717 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.702507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.715474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1119/2224] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:49.716297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.732553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] MFA Rules not processed for user `df586c3b6e364acfa97537ad07f260a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:49.734439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:49.734960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2354b-4eca-448d-959d-514b682772b3 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.801204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:49.809706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.810378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.810666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.810947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.811679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.812435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1106/2225] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:49.813266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.813812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.814532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:49.828085 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:49.838499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1120/2226] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:49 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:49.839543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.849764 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b51fe-4d3a-48df-928b-11693d1e1116 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.854456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.855675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.855953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.856245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.856939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.858850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.882446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ad33-0c6c-486f-b161-6a0a15716200 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.888229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1121/2227] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:49 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:49.888229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.888471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.888471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.888471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.888471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.950744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.952250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.962095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1107/2228] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:49.965366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:49.977300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504866a7-30b5-4829-a00e-3902c6f76e96 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.977697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac01a-e61f-4293-a747-1a38a2709e4f service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:49.983785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.984606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:49.984729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.984952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.985266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:49.985550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:49.985827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.985974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:49.986516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.986762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:49.988455 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:49.989078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.000593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1122/2229] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:50.004540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.010856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1108/2230] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:49 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:50.014718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.018281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42483b1-a49b-4510-a955-78ff57d8f78d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.023366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.024035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.024321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.024601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.025326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.026652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d3801-d4ec-430c-94e3-97ba769615fc admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.026913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.032683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.033348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.033646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.033917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.034652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.036281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.041092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1123/2231] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:50.045565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.050215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1109/2232] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:50.051600 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.060870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4e25f-2735-465e-bb07-c17b4e55db3e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.063706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09c4fe-cbdb-4fbf-a1d5-f3ee0ecb48d5 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.065966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea974c2-f8d6-4f37-9a51-e49bdd987ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.066890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea974c2-f8d6-4f37-9a51-e49bdd987ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.067508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea974c2-f8d6-4f37-9a51-e49bdd987ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.067804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea974c2-f8d6-4f37-9a51-e49bdd987ec3 admin admin] PATH_INFO: `/v3/projects/32a90498212744cdb828598ada2a2d72/users/23a94dc05b10442fae03148b7f223926/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.069541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.070695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.070970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.072102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] PATH_INFO: `/v3/projects/85a7147989304f9dabde19e6857fb3b0/users/1cd6b52a9b77479fb8b5009de0a0dd09/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.084428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea974c2-f8d6-4f37-9a51-e49bdd987ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a90498212744cdb828598ada2a2d72, user_id=23a94dc05b10442fae03148b7f223926, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.087762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea974c2-f8d6-4f37-9a51-e49bdd987ec3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.090610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a7147989304f9dabde19e6857fb3b0, user_id=1cd6b52a9b77479fb8b5009de0a0dd09, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.093660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.104847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1124/2233] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:50 2022] PUT /identity/v3/projects/32a90498212744cdb828598ada2a2d72/users/23a94dc05b10442fae03148b7f223926/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:50.115637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8bce-a49d-4942-ae89-c275af98cad2 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.115937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8bce-a49d-4942-ae89-c275af98cad2 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.116312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8bce-a49d-4942-ae89-c275af98cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.117002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1110/2234] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:50 2022] PUT /identity/v3/projects/85a7147989304f9dabde19e6857fb3b0/users/1cd6b52a9b77479fb8b5009de0a0dd09/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:50.121681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.145934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-c3bc8bce-a49d-4942-ae89-c275af98cad2 None None] MFA Rules not processed for user `23a94dc05b10442fae03148b7f223926`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:50.148641 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c3bc8bce-a49d-4942-ae89-c275af98cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:50.194110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b62b-6c04-49a7-b915-506743408585 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.200435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.201263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.201596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.201886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.202696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.204743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.216864 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1111/2235] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:50.221047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.231396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9884986-e720-479f-8fbe-e96cd380651e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.236588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1125/2236] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:50.237521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.238937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.239447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.239930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] PATH_INFO: `/v3/projects/85a7147989304f9dabde19e6857fb3b0/users/1cd6b52a9b77479fb8b5009de0a0dd09/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.241041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8bce-a49d-4942-ae89-c275af98cad2 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.243288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a7147989304f9dabde19e6857fb3b0, user_id=1cd6b52a9b77479fb8b5009de0a0dd09, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.247888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.254143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:50.258879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8bce-a49d-4942-ae89-c275af98cad2 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.264099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1112/2237] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:50 2022] PUT /identity/v3/projects/85a7147989304f9dabde19e6857fb3b0/users/1cd6b52a9b77479fb8b5009de0a0dd09/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:50.289092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:50.359764 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.360540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.360828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.361106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.361867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.364247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.403478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1126/2238] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:50 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:50.404570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.426680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17161a35-740d-47ac-b4e1-925501eaba99 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.523710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.524381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.524668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.524946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.525653 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.528454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.553411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1113/2239] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:50 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:47:50.557420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.567888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501fc4c-9e9c-4fa9-8d25-6b060e9fb7a5 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.572750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.573424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.573715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.574539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.575363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.576982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.590307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1127/2240] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:50.594702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.605719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519d69e-0954-467c-ae49-b75971885f82 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.611687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.612531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.612734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.613034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] PATH_INFO: `/v3/projects/34be547dd15a47c6864c2331d41d5192/users/44d9cbebae524aecb4f6ba97459af629/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.636105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34be547dd15a47c6864c2331d41d5192, user_id=44d9cbebae524aecb4f6ba97459af629, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.640226 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.673267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1114/2241] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:50 2022] PUT /identity/v3/projects/34be547dd15a47c6864c2331d41d5192/users/44d9cbebae524aecb4f6ba97459af629/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:50.678371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.692545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4863-c55e-4144-8db8-5efd665e334d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.769250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727889fd-bcd0-4ecd-9d03-277b335ccc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.769925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727889fd-bcd0-4ecd-9d03-277b335ccc44 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.770210 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727889fd-bcd0-4ecd-9d03-277b335ccc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.770487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727889fd-bcd0-4ecd-9d03-277b335ccc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.771244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727889fd-bcd0-4ecd-9d03-277b335ccc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.773111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727889fd-bcd0-4ecd-9d03-277b335ccc44 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.784503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1128/2242] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:47:50.788357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:50.798836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcb04d-9cb3-4e39-b4d8-1bc7aa29862f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:50.803730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:50.804550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.804835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.805110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] PATH_INFO: `/v3/projects/34be547dd15a47c6864c2331d41d5192/users/44d9cbebae524aecb4f6ba97459af629/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.807291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34be547dd15a47c6864c2331d41d5192, user_id=44d9cbebae524aecb4f6ba97459af629, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:50.810585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:50.825267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1115/2243] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:50 2022] PUT /identity/v3/projects/34be547dd15a47c6864c2331d41d5192/users/44d9cbebae524aecb4f6ba97459af629/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:50.836152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61628f-8164-4b77-8914-74ecbd58cb75 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:50.836449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61628f-8164-4b77-8914-74ecbd58cb75 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:50.836738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61628f-8164-4b77-8914-74ecbd58cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:50.863896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-3c61628f-8164-4b77-8914-74ecbd58cb75 None None] MFA Rules not processed for user `44d9cbebae524aecb4f6ba97459af629`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:50.865112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3c61628f-8164-4b77-8914-74ecbd58cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:50.956177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1129/2244] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:50.970142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:51.033345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90d90-ee55-4cda-ab76-77c3539ccf0b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:51.035370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:51.035944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:51.036516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:51.038315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3234a-a65f-440c-abd1-e11a2056059c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:51.039234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3234a-a65f-440c-abd1-e11a2056059c service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:51.039690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3234a-a65f-440c-abd1-e11a2056059c service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:51.040065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3234a-a65f-440c-abd1-e11a2056059c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:51.057800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:51.068788 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] MFA Rules not processed for user `1cd6b52a9b77479fb8b5009de0a0dd09`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:51.076688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:51.118255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3234a-a65f-440c-abd1-e11a2056059c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:51.121364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3234a-a65f-440c-abd1-e11a2056059c service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:51.138616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1116/2245] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:51.164665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1130/2246] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:47:51.175686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103a11-89b9-452d-8e11-2aec1a473069 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:51.176052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103a11-89b9-452d-8e11-2aec1a473069 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:51.176406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103a11-89b9-452d-8e11-2aec1a473069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:51.182569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:51.198446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-36103a11-89b9-452d-8e11-2aec1a473069 None None] MFA Rules not processed for user `df586c3b6e364acfa97537ad07f260a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:51.200067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-36103a11-89b9-452d-8e11-2aec1a473069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:51.273357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1117/2247] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:51.286143 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:51.288396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:51.375621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6330d-9bbf-4a07-ac0e-5c55824e5a8c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:51.381998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:51.382731 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:51.383119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:51.383541 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:51.392612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:51.394284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:51.404155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1131/2248] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:52.689077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103a11-89b9-452d-8e11-2aec1a473069 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:52.699382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103a11-89b9-452d-8e11-2aec1a473069 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:52.702935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:52.703598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:52.703888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:52.704213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:52.760546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:52.762511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:52.771384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1118/2249] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:53.370479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:53.381290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac283-8acc-4667-b504-cc9b3ae8b029 service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:53.385897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5854a5f-4aec-402d-a197-e8dfd496e92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:53.386582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5854a5f-4aec-402d-a197-e8dfd496e92f service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:53.386887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5854a5f-4aec-402d-a197-e8dfd496e92f service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:53.387324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5854a5f-4aec-402d-a197-e8dfd496e92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:53.397499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5854a5f-4aec-402d-a197-e8dfd496e92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:53.398925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5854a5f-4aec-402d-a197-e8dfd496e92f service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:53.409540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1132/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:53.573189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:53.655047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593d91-f1d1-4269-8cff-6ab76e0e4f9a service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:53.659867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:53.660808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:53.661109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:53.661392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] PATH_INFO: `/v3/users/c1e2c4903b7c4c1f9f70c133011b871f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:53.662662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e2c4903b7c4c1f9f70c133011b871f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:53.665467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:53.716496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e2c4903b7c4c1f9f70c133011b871f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:53.717688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:53.732623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e2c4903b7c4c1f9f70c133011b871f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:53.739135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e2c4903b7c4c1f9f70c133011b871f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:53.746800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e2c4903b7c4c1f9f70c133011b871f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:53.747466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e2c4903b7c4c1f9f70c133011b871f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:53.756439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1119/2251] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:53 2022] DELETE /identity/v3/users/c1e2c4903b7c4c1f9f70c133011b871f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:53.758298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:53.758694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:53.758983 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:53.776694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:53.778446 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:53.843285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1133/2252] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:53.852989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:53.854421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:53.916309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bffa0-7769-49b0-a011-a2e9bf249873 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:53.920715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:53.921395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:53.921678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:53.921954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:53.931327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:53.932767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:53.943030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1120/2253] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:54.459932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:54.467486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:54.473914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8e6ef-8931-4cc0-987b-8dd53457e4e8 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:54.478833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:54.486728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:54.487070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:54.487429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] PATH_INFO: `/v3/projects/05442a9d8aef417ea959bf42468e7d33` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:54.500293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=05442a9d8aef417ea959bf42468e7d33)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:54.502798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:54.507767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:54.564608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05442a9d8aef417ea959bf42468e7d33', 'request_id': 'req-9461ac2b-bd68-40db-a32b-8614cab4d3ee'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.571324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05442a9d8aef417ea959bf42468e7d33', 'request_id': 'req-9461ac2b-bd68-40db-a32b-8614cab4d3ee'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.580892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05442a9d8aef417ea959bf42468e7d33', 'request_id': 'req-9461ac2b-bd68-40db-a32b-8614cab4d3ee'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.596544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] The token cache is being invalidate because project 05442a9d8aef417ea959bf42468e7d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:54.596870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.598110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.602900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1134/2254] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:54 2022] DELETE /identity/v3/projects/05442a9d8aef417ea959bf42468e7d33 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:54.604200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:54.615752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb240453-e6c8-4019-9c5d-eef00cd80c8a service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:54.712746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:54.713826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:54.714322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:54.715175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] PATH_INFO: `/v3/users/738d4cdfdba74137b729167ff9853d9e` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:54.716608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=738d4cdfdba74137b729167ff9853d9e)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:54.718773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:54.784898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738d4cdfdba74137b729167ff9853d9e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.805687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738d4cdfdba74137b729167ff9853d9e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.811264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:54.818463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738d4cdfdba74137b729167ff9853d9e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.835081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738d4cdfdba74137b729167ff9853d9e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.836725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec0d791b-e6d6-46cf-b2e0-92362d5e4f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738d4cdfdba74137b729167ff9853d9e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:54.850161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1121/2255] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:54 2022] DELETE /identity/v3/users/738d4cdfdba74137b729167ff9853d9e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:55.226977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.228463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:55.250706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461ac2b-bd68-40db-a32b-8614cab4d3ee admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:55.325299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:55.326208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.326456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.326776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] PATH_INFO: `/v3/projects/f017f2cef0c74643b14fab6e2b4f9a49` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.328335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f017f2cef0c74643b14fab6e2b4f9a49)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:55.330589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:55.385536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f017f2cef0c74643b14fab6e2b4f9a49', 'request_id': 'req-e343994c-1fa1-48f0-a071-8ddccc796283'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:55.393747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f017f2cef0c74643b14fab6e2b4f9a49', 'request_id': 'req-e343994c-1fa1-48f0-a071-8ddccc796283'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:55.404556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f017f2cef0c74643b14fab6e2b4f9a49', 'request_id': 'req-e343994c-1fa1-48f0-a071-8ddccc796283'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:55.420496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] The token cache is being invalidate because project f017f2cef0c74643b14fab6e2b4f9a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:55.421293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:55.422537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e343994c-1fa1-48f0-a071-8ddccc796283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:55.425234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1135/2256] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:55 2022] DELETE /identity/v3/projects/f017f2cef0c74643b14fab6e2b4f9a49 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:55.431093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a9fb-4c3c-4c80-94f0-9db6f2115346 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.431412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a9fb-4c3c-4c80-94f0-9db6f2115346 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.431698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a9fb-4c3c-4c80-94f0-9db6f2115346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.450688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9d78a9fb-4c3c-4c80-94f0-9db6f2115346 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:55.451929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9d78a9fb-4c3c-4c80-94f0-9db6f2115346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:55.539270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1122/2257] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:55.546647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0139-4c60-4629-ac47-1b97f6fabe91 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.546647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0139-4c60-4629-ac47-1b97f6fabe91 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.547399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0139-4c60-4629-ac47-1b97f6fabe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.565295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e90b0139-4c60-4629-ac47-1b97f6fabe91 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:55.566537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e90b0139-4c60-4629-ac47-1b97f6fabe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:55.574560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1136/2258] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:55.578766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a9fb-4c3c-4c80-94f0-9db6f2115346 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.588405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a9fb-4c3c-4c80-94f0-9db6f2115346 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:55.593954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:55.594648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.594935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.595272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.596005 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:55.596321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:55.597917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:55.610169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1123/2259] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:55.614515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0139-4c60-4629-ac47-1b97f6fabe91 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.623737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0139-4c60-4629-ac47-1b97f6fabe91 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:55.628247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:55.628885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.629171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.629447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.630143 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:55.632095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:55.642260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:55.659803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1137/2260] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:55 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:55.663888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.673930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632d6c-d24c-48a0-8811-32506223fb9c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:55.728478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:55.729143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.729431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.729712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.730420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:55.732415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:55.751517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1124/2261] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:55 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:55.756061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.766667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaccfdc-4c93-4499-bf04-e3033dc2c706 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:55.771187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:55.771883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.772169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.772712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.773430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:55.775016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:55.785683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1138/2262] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:55.789450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.799150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bf054-2b4b-46aa-abed-d9cd7de2c2e9 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:55.803755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ad542-4368-49b0-bd76-29ccc41d5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:55.804403 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ad542-4368-49b0-bd76-29ccc41d5ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.804691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ad542-4368-49b0-bd76-29ccc41d5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.804974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ad542-4368-49b0-bd76-29ccc41d5ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.805700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ad542-4368-49b0-bd76-29ccc41d5ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:55.807315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ad542-4368-49b0-bd76-29ccc41d5ec0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:55.817123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1125/2263] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:55.821025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.831004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b1045-7138-4fef-af6a-c8f662040458 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:55.835566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:55.836418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.836701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.836978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] PATH_INFO: `/v3/projects/dd3be9fa8acc417aa55eb33cf52004be/users/2f5fd67da4e64e72a4d8861fc0531008/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.851485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3be9fa8acc417aa55eb33cf52004be, user_id=2f5fd67da4e64e72a4d8861fc0531008, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:55.854228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:55.866540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1139/2264] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:47:55 2022] PUT /identity/v3/projects/dd3be9fa8acc417aa55eb33cf52004be/users/2f5fd67da4e64e72a4d8861fc0531008/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:55.877389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:55.877687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:55.877974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:55.904876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] MFA Rules not processed for user `2f5fd67da4e64e72a4d8861fc0531008`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:55.906072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:55.946453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:55.970993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1126/2265] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:55.983057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:55.984695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:56.042828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e53e4e-44f0-4206-b16f-4e44c793ef5a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:56.046440 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae2623-0f5e-4060-88dd-d454f7485a59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:56.047091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae2623-0f5e-4060-88dd-d454f7485a59 service glance] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:56.047407 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae2623-0f5e-4060-88dd-d454f7485a59 service glance] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:56.047690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae2623-0f5e-4060-88dd-d454f7485a59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:56.059693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae2623-0f5e-4060-88dd-d454f7485a59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:56.061179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae2623-0f5e-4060-88dd-d454f7485a59 service glance] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:56.070403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1140/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:57.459257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:57.460662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:57.539872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227e7a7-b4bd-4b4d-be81-8f9860e63575 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:57.545084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:57.546030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:57.546406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:57.546746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] PATH_INFO: `/v3/users/b21417e297604817a4337de395ca5dbd` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:57.547986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21417e297604817a4337de395ca5dbd)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:57.550373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:57.606475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21417e297604817a4337de395ca5dbd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:57.619328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21417e297604817a4337de395ca5dbd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:57.628011 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21417e297604817a4337de395ca5dbd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:57.637409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21417e297604817a4337de395ca5dbd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:57.638121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21417e297604817a4337de395ca5dbd'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:57.644076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1127/2267] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:57 2022] DELETE /identity/v3/users/b21417e297604817a4337de395ca5dbd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:57.648887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:57.649349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:57.649440 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:57.665959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:57.667302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:57.731356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1141/2268] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:57.740877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:57.742283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:57.814956 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccf8f1-7fd7-4991-9a1b-c4777b1e412c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:57.820218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:57.820650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:57.821025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:57.822395 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:57.832372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:57.833977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:57.851315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1128/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:47:58.204182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:58.205647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:58.218632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af13e88-c8bd-4b4f-a072-008757e47685 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:58.223340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:58.224340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:58.224691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:58.225041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] PATH_INFO: `/v3/projects/92398b8afcfd4d3a82213c810dc960f5` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:58.226239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92398b8afcfd4d3a82213c810dc960f5)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:58.228189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:58.275702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92398b8afcfd4d3a82213c810dc960f5', 'request_id': 'req-fc3a640f-bed7-43f9-aef1-c7f888b40425'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.280003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:58.282453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92398b8afcfd4d3a82213c810dc960f5', 'request_id': 'req-fc3a640f-bed7-43f9-aef1-c7f888b40425'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.292158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92398b8afcfd4d3a82213c810dc960f5', 'request_id': 'req-fc3a640f-bed7-43f9-aef1-c7f888b40425'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.306956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] The token cache is being invalidate because project 92398b8afcfd4d3a82213c810dc960f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:58.307085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.307818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.309454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1142/2270] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:58 2022] DELETE /identity/v3/projects/92398b8afcfd4d3a82213c810dc960f5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:58.313669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:58.319816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:58.324110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e57a4-2733-4c7d-9584-53d4b0119fd2 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:58.420539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:58.421646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:58.422714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:58.423006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] PATH_INFO: `/v3/users/23a94dc05b10442fae03148b7f223926` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:58.424303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a94dc05b10442fae03148b7f223926)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:58.426322 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:58.491916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a94dc05b10442fae03148b7f223926'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.504639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a94dc05b10442fae03148b7f223926'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.512674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a94dc05b10442fae03148b7f223926'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.520012 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a94dc05b10442fae03148b7f223926'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.520655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a94dc05b10442fae03148b7f223926'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.527629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1129/2271] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:58 2022] DELETE /identity/v3/users/23a94dc05b10442fae03148b7f223926 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:58.826982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:58.828509 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:58.842166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a640f-bed7-43f9-aef1-c7f888b40425 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:58.899599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:58.900393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:58.900676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:58.900951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] PATH_INFO: `/v3/projects/32a90498212744cdb828598ada2a2d72` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:58.902695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a90498212744cdb828598ada2a2d72)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:58.904719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:58.950332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a90498212744cdb828598ada2a2d72', 'request_id': 'req-c97cfbab-89f5-40ac-8b31-6067c9d80252'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.955885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a90498212744cdb828598ada2a2d72', 'request_id': 'req-c97cfbab-89f5-40ac-8b31-6067c9d80252'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.963109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a90498212744cdb828598ada2a2d72', 'request_id': 'req-c97cfbab-89f5-40ac-8b31-6067c9d80252'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.974526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] The token cache is being invalidate because project 32a90498212744cdb828598ada2a2d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:58.974813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.975471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c97cfbab-89f5-40ac-8b31-6067c9d80252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:58.977003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1143/2272] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:58 2022] DELETE /identity/v3/projects/32a90498212744cdb828598ada2a2d72 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:47:58.980950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:58.982345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:58.984676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:58.984955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:58.985223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:58.998186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4cf37-cb85-47e7-96b9-8922d2796fa9 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.015959 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:59.016898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:59.079601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.082117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.082645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.083036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] PATH_INFO: `/v3/users/44d9cbebae524aecb4f6ba97459af629` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.090983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d9cbebae524aecb4f6ba97459af629)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.093097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:59.112587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1144/2273] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:59.142019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:59.142231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:59.143662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:59.164767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:59.170364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d9cbebae524aecb4f6ba97459af629'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.184752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d9cbebae524aecb4f6ba97459af629'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.194062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d9cbebae524aecb4f6ba97459af629'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.203499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d9cbebae524aecb4f6ba97459af629'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.204334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d9cbebae524aecb4f6ba97459af629'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.212907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1130/2274] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:47:58 2022] DELETE /identity/v3/users/44d9cbebae524aecb4f6ba97459af629 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:59.239925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87050b48-3293-49d1-b1a4-372e74456df4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.317781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13eee3a-aae1-44c0-9afb-8a927bb318ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.318984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eee3a-aae1-44c0-9afb-8a927bb318ce service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.319639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eee3a-aae1-44c0-9afb-8a927bb318ce service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.320368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eee3a-aae1-44c0-9afb-8a927bb318ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.324537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c13eee3a-aae1-44c0-9afb-8a927bb318ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:59.396213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eee3a-aae1-44c0-9afb-8a927bb318ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.398301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eee3a-aae1-44c0-9afb-8a927bb318ce service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:59.410656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1145/2275] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:47:59.501535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:59.503031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:59.522819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d7f8f-0a90-4bbe-88cb-d12ef53ffce4 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.527890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.528841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.529022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.529299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] PATH_INFO: `/v3/projects/34be547dd15a47c6864c2331d41d5192` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.530481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34be547dd15a47c6864c2331d41d5192)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.532428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:59.582281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34be547dd15a47c6864c2331d41d5192', 'request_id': 'req-46d5160a-9a35-4a60-85d9-74b162f4d353'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.588680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34be547dd15a47c6864c2331d41d5192', 'request_id': 'req-46d5160a-9a35-4a60-85d9-74b162f4d353'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.601142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34be547dd15a47c6864c2331d41d5192', 'request_id': 'req-46d5160a-9a35-4a60-85d9-74b162f4d353'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.613476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] The token cache is being invalidate because project 34be547dd15a47c6864c2331d41d5192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:47:59.613850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.614612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-46d5160a-9a35-4a60-85d9-74b162f4d353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:47:59.619307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1131/2276] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:47:59 2022] DELETE /identity/v3/projects/34be547dd15a47c6864c2331d41d5192 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:47:59.622673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1fa9-a40b-4c0e-97af-4d634aba0054 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.623070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1fa9-a40b-4c0e-97af-4d634aba0054 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.623481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1fa9-a40b-4c0e-97af-4d634aba0054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.642300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f86d1fa9-a40b-4c0e-97af-4d634aba0054 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:59.643682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f86d1fa9-a40b-4c0e-97af-4d634aba0054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:59.687759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:59.706191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1146/2277] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:59.714072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ebaac-e0dd-4c98-9299-e11208446499 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.714874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ebaac-e0dd-4c98-9299-e11208446499 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.715161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ebaac-e0dd-4c98-9299-e11208446499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.734171 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-482ebaac-e0dd-4c98-9299-e11208446499 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:47:59.735416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-482ebaac-e0dd-4c98-9299-e11208446499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:47:59.743253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1132/2278] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:47:59.747575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1fa9-a40b-4c0e-97af-4d634aba0054 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:59.757082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1fa9-a40b-4c0e-97af-4d634aba0054 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.761554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.762200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.762487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.762768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.763539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:47:59.763847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.765431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:59.778300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1147/2279] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:47:59.782512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ebaac-e0dd-4c98-9299-e11208446499 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:59.791646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ebaac-e0dd-4c98-9299-e11208446499 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.796875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.797531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.797844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.798123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.798822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.800767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:59.829380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1133/2280] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:47:59 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:59.833488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:59.844103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff2b95-57d5-42b1-965e-4f7e75f3ab78 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.905389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.906199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.906646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.907170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.907990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.909991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:59.934349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1148/2281] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:47:59 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:47:59.938651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:59.949221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe69c-46ff-4c6c-bcfc-8553fec13197 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.954725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.955559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.955908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.956366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.957052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.958742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:47:59.972478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1134/2282] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:47:59.976563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:47:59.987848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add59ff4-e0d3-45e6-a01b-5f07eb39da4a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:47:59.994473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a9711-0e45-4797-ad48-60e5be6188b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:47:59.995138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9711-0e45-4797-ad48-60e5be6188b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:47:59.995453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9711-0e45-4797-ad48-60e5be6188b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:47:59.995759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9711-0e45-4797-ad48-60e5be6188b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:47:59.996491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a9711-0e45-4797-ad48-60e5be6188b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:47:59.998081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a9711-0e45-4797-ad48-60e5be6188b4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:00.012479 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1149/2283] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:00.013064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:00.024552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d57e-cfc0-49ad-bc97-0b5504a3d68e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:00.029689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:00.030569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:00.030887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:00.031166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] PATH_INFO: `/v3/projects/af09af590bd549e4a6bda5a501f18fb2/users/793f6cefd07b4150be2d2f647a283d15/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:00.047109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af09af590bd549e4a6bda5a501f18fb2, user_id=793f6cefd07b4150be2d2f647a283d15, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:00.050571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:00.064288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1135/2284] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:00 2022] PUT /identity/v3/projects/af09af590bd549e4a6bda5a501f18fb2/users/793f6cefd07b4150be2d2f647a283d15/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:00.075188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505defe-d8c8-405c-b6c5-e6f9189d04fc None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:00.075562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505defe-d8c8-405c-b6c5-e6f9189d04fc None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:00.075863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505defe-d8c8-405c-b6c5-e6f9189d04fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:00.103139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4505defe-d8c8-405c-b6c5-e6f9189d04fc None None] MFA Rules not processed for user `793f6cefd07b4150be2d2f647a283d15`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:00.104393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4505defe-d8c8-405c-b6c5-e6f9189d04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:00.171264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1150/2285] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:00.181578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:00.183371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:00.211328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:00.257254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3042c2-abb3-477c-940d-5e87bcfaf9c3 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:00.262787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cfda4-b395-4ffc-9924-a8bec9ed3d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:00.263596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cfda4-b395-4ffc-9924-a8bec9ed3d35 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:00.263991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cfda4-b395-4ffc-9924-a8bec9ed3d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:00.264593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cfda4-b395-4ffc-9924-a8bec9ed3d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:00.277854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cfda4-b395-4ffc-9924-a8bec9ed3d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:00.280671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cfda4-b395-4ffc-9924-a8bec9ed3d35 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:00.303351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1136/2286] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:01.690017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:01.690495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:01.690658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:01.708203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] MFA Rules not processed for user `793f6cefd07b4150be2d2f647a283d15`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:01.709399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:01.717230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1151/2287] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:02.000057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e177dec-1281-4836-81fd-9b24ea9fa2c4 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:02.000627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e177dec-1281-4836-81fd-9b24ea9fa2c4 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:02.000627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e177dec-1281-4836-81fd-9b24ea9fa2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:02.019260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7e177dec-1281-4836-81fd-9b24ea9fa2c4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:02.020463 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7e177dec-1281-4836-81fd-9b24ea9fa2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:02.087036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1137/2288] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:02.107640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:02.109202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:02.144230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:02.198813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82925111-68b8-4a99-8002-d4b1c4171de5 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:02.211460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0d886-ec4c-4040-8ad5-19639d800e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:02.223070 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0d886-ec4c-4040-8ad5-19639d800e68 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:02.223616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0d886-ec4c-4040-8ad5-19639d800e68 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:02.224078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0d886-ec4c-4040-8ad5-19639d800e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:02.234305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0d886-ec4c-4040-8ad5-19639d800e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:02.236168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0d886-ec4c-4040-8ad5-19639d800e68 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:02.248782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1152/2289] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:06.779386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e177dec-1281-4836-81fd-9b24ea9fa2c4 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:06.788911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e177dec-1281-4836-81fd-9b24ea9fa2c4 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:06.792564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:06.793249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:06.793631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:06.794037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:06.795877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:06.864787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:06.866246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:06.876676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1138/2290] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:07.444833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081817bb-8892-4249-beb0-1707d8eaf9e9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:07.445295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081817bb-8892-4249-beb0-1707d8eaf9e9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:07.445678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081817bb-8892-4249-beb0-1707d8eaf9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:07.467023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-081817bb-8892-4249-beb0-1707d8eaf9e9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:07.468472 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-081817bb-8892-4249-beb0-1707d8eaf9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:07.476739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1153/2291] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:07.501498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:07.502654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:07.537021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15598ba-196a-4318-b2fd-4f2c5d41a23a service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:07.557759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:07.558741 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:07.559101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:07.559520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:07.570440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:07.572182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:07.587274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1139/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:12.605869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:12.606423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:12.606626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:12.637750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:12.640066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:12.650608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1154/2293] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:12.668516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:12.680802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49646b6-a70c-42da-9650-31aea0b81975 service nova] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:12.687658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780830-c772-48d6-a588-8dd49fefa396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:12.689222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780830-c772-48d6-a588-8dd49fefa396 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:12.689511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780830-c772-48d6-a588-8dd49fefa396 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:12.689794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780830-c772-48d6-a588-8dd49fefa396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:12.703719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30780830-c772-48d6-a588-8dd49fefa396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:12.705443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30780830-c772-48d6-a588-8dd49fefa396 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:12.716034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1140/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:15.781013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:15.782620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:15.794937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e26cb-6242-4aa4-8b7a-1007eb13d995 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:15.805001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:15.806404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:15.806746 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:15.807103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] PATH_INFO: `/v3/users/2f5fd67da4e64e72a4d8861fc0531008` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:15.808918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5fd67da4e64e72a4d8861fc0531008)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:15.811503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:15.876653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5fd67da4e64e72a4d8861fc0531008'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.894299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5fd67da4e64e72a4d8861fc0531008'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.894856 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5fd67da4e64e72a4d8861fc0531008'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.906177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5fd67da4e64e72a4d8861fc0531008'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.914414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5fd67da4e64e72a4d8861fc0531008'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:15.922102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1155/2295] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:15 2022] DELETE /identity/v3/users/2f5fd67da4e64e72a4d8861fc0531008 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:15.926750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:15.927777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:15.928277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:15.949616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:15.950959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:15.993112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:16.028669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1141/2296] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:16.038640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.040224 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:16.101609 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7b6bc-39c0-490c-b94b-4f60585f68d1 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.106386 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae93892-0868-43ff-8bd0-f840e26cd109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.107155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93892-0868-43ff-8bd0-f840e26cd109 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.107480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93892-0868-43ff-8bd0-f840e26cd109 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.107769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93892-0868-43ff-8bd0-f840e26cd109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.117192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae93892-0868-43ff-8bd0-f840e26cd109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.118630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae93892-0868-43ff-8bd0-f840e26cd109 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.130379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1156/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:16.406628 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.408081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:16.436089 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75b5d1-3a11-4915-8c78-1476adba68c0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.441464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.442621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.442911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.443492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] PATH_INFO: `/v3/projects/dd3be9fa8acc417aa55eb33cf52004be` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.445026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3be9fa8acc417aa55eb33cf52004be)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.447382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.510210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3be9fa8acc417aa55eb33cf52004be', 'request_id': 'req-8936d466-9024-4377-927e-94c134e8e18e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.517230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3be9fa8acc417aa55eb33cf52004be', 'request_id': 'req-8936d466-9024-4377-927e-94c134e8e18e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.525656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3be9fa8acc417aa55eb33cf52004be', 'request_id': 'req-8936d466-9024-4377-927e-94c134e8e18e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.537110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] The token cache is being invalidate because project dd3be9fa8acc417aa55eb33cf52004be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:16.537423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.538059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8936d466-9024-4377-927e-94c134e8e18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:16.539888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1142/2298] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:16 2022] DELETE /identity/v3/projects/dd3be9fa8acc417aa55eb33cf52004be => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:16.544676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ef75-afa7-4d1c-8a8a-7243ca44b13e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.544969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ef75-afa7-4d1c-8a8a-7243ca44b13e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.545252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ef75-afa7-4d1c-8a8a-7243ca44b13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.563403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8b99ef75-afa7-4d1c-8a8a-7243ca44b13e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:16.564621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8b99ef75-afa7-4d1c-8a8a-7243ca44b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:16.577937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:16.626637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1157/2299] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:16.634366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287fd4e-102b-438f-a378-613c6cefc178 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.634663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287fd4e-102b-438f-a378-613c6cefc178 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.634949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287fd4e-102b-438f-a378-613c6cefc178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.654208 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b287fd4e-102b-438f-a378-613c6cefc178 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:16.655438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b287fd4e-102b-438f-a378-613c6cefc178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:16.663297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1143/2300] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:16.667847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ef75-afa7-4d1c-8a8a-7243ca44b13e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.677762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ef75-afa7-4d1c-8a8a-7243ca44b13e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.682550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.683808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.684091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.684367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.685112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:16.685398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.686998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.698720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1158/2301] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:16.702898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287fd4e-102b-438f-a378-613c6cefc178 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.712190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287fd4e-102b-438f-a378-613c6cefc178 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.717338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.717876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.718167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.718469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.719173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.721117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.748595 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1144/2302] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:16 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:16.752698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.763083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5df7d-8c9e-4532-9212-e258a2e9d59f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.830971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.831703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.831952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.832231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.832928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.834883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.855243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1159/2303] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:16 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:16.859158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.869814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6deff6-3e3b-4297-ae93-8ccc0cb313b0 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.874533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.875196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.875515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.875793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.876526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.878115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.889139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1145/2304] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:16.893025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.903932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25453-5eba-439d-a136-4eb8b9a41a7e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.908533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a302-a001-42ee-815a-b7d4cc91325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.909197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a302-a001-42ee-815a-b7d4cc91325a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.909535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a302-a001-42ee-815a-b7d4cc91325a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.910011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a302-a001-42ee-815a-b7d4cc91325a admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.910568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a302-a001-42ee-815a-b7d4cc91325a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.912188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a302-a001-42ee-815a-b7d4cc91325a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.922159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1160/2305] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:16.926418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:16.939333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222b80-5071-4643-822a-fee859f53663 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:16.944004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:16.944896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.945185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.945468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] PATH_INFO: `/v3/projects/dcef2b3be23d47e985b737285074ff70/users/85cd4fb380ca4fc3b7cea2004041aa76/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:16.960913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcef2b3be23d47e985b737285074ff70, user_id=85cd4fb380ca4fc3b7cea2004041aa76, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:16.965086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:16.978714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1146/2306] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:16 2022] PUT /identity/v3/projects/dcef2b3be23d47e985b737285074ff70/users/85cd4fb380ca4fc3b7cea2004041aa76/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:16.989186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433608-ce6d-4400-9982-2870db7cc86b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:16.989486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433608-ce6d-4400-9982-2870db7cc86b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:16.989776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433608-ce6d-4400-9982-2870db7cc86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.017422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f5433608-ce6d-4400-9982-2870db7cc86b None None] MFA Rules not processed for user `85cd4fb380ca4fc3b7cea2004041aa76`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:17.018718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f5433608-ce6d-4400-9982-2870db7cc86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:17.085673 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1161/2307] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:17.099026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:17.101085 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:17.179767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0882e1-01b5-4bbb-9ee3-993376d50bbd admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:17.184311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:17.185031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:17.185433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:17.185843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:17.192536 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:17.195024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:17.196892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:17.209260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1147/2308] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:24.083117 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e98f5-0f35-45da-8700-83cab79d3287 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:24.083665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e98f5-0f35-45da-8700-83cab79d3287 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:24.083753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e98f5-0f35-45da-8700-83cab79d3287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:24.102519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b30e98f5-0f35-45da-8700-83cab79d3287 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:24.103853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b30e98f5-0f35-45da-8700-83cab79d3287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:24.113986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:24.166797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1162/2309] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:24.185656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:24.187088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:24.263945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ce935-9928-41c2-a14c-53d411289c1b service glance] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:24.269405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29953782-cbc8-4c76-94b8-a5c84964f056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:24.270052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29953782-cbc8-4c76-94b8-a5c84964f056 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:24.270334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29953782-cbc8-4c76-94b8-a5c84964f056 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:24.270613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29953782-cbc8-4c76-94b8-a5c84964f056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:24.279388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29953782-cbc8-4c76-94b8-a5c84964f056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:24.280972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29953782-cbc8-4c76-94b8-a5c84964f056 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:24.292355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1148/2310] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:29.249252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2bec-5b42-4aa3-95e1-d236eac938fd None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:29.249854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2bec-5b42-4aa3-95e1-d236eac938fd None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:29.255278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2bec-5b42-4aa3-95e1-d236eac938fd None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:29.261414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1163/2311] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:48:29 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:48:29.270970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:29.271470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:29.271623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:29.315950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] MFA Rules not processed for user `5937de29a4c04fb9ab79f5ef77b24a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:29.318027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:29.438508 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1149/2312] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:29.449756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d2bec-5b42-4aa3-95e1-d236eac938fd None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:29.452106 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bb6d2bec-5b42-4aa3-95e1-d236eac938fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:29.519974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d2bec-5b42-4aa3-95e1-d236eac938fd None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:29.536683 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689a7e4-22eb-4b78-94f7-4f490f3e5d2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:29.538331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689a7e4-22eb-4b78-94f7-4f490f3e5d2a service placement] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:29.539657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689a7e4-22eb-4b78-94f7-4f490f3e5d2a service placement] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:29.542516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689a7e4-22eb-4b78-94f7-4f490f3e5d2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:29.551682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:29.556377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:29.612827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689a7e4-22eb-4b78-94f7-4f490f3e5d2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:29.613603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2bdb-80a9-4a5d-ba42-f42a7d31cadb None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:29.616058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689a7e4-22eb-4b78-94f7-4f490f3e5d2a service placement] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:29.635543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1164/2313] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:29.636363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:29.641555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:29.643791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:29.645697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] PATH_INFO: `/v3/users/df586c3b6e364acfa97537ad07f260a2` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:29.648771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=df586c3b6e364acfa97537ad07f260a2)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:29.659832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:29.747951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df586c3b6e364acfa97537ad07f260a2'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:29.779174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df586c3b6e364acfa97537ad07f260a2'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:29.792449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df586c3b6e364acfa97537ad07f260a2'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:29.794424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:29.808190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df586c3b6e364acfa97537ad07f260a2'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:29.808936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-afe0b67e-0352-48dc-b551-5986e293ebbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df586c3b6e364acfa97537ad07f260a2'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:29.820158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1150/2314] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:29 2022] DELETE /identity/v3/users/df586c3b6e364acfa97537ad07f260a2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:29.993827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:29.994229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:29.994740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:30.016347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] MFA Rules not processed for user `c468cd8df1564441935e4edfba55ccc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:30.017642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:30.078399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1165/2315] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:30.449980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:30.450862 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:30.451324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:30.499182 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:30.501691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:30.543180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:30.545125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:30.595855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1151/2316] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:30.632987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:30.634976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:30.651019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b1b91-d905-4d9e-a33e-13ee491381d0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:30.657954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:30.659345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:30.659768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:30.660057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] PATH_INFO: `/v3/projects/b8f7ca1f7a5d4049a13102ed00629c9a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:30.661840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f7ca1f7a5d4049a13102ed00629c9a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:30.666063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:30.738308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f7ca1f7a5d4049a13102ed00629c9a', 'request_id': 'req-fdaca04c-8a52-4ee5-99c3-830490501e84'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:30.740435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:30.754197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f7ca1f7a5d4049a13102ed00629c9a', 'request_id': 'req-fdaca04c-8a52-4ee5-99c3-830490501e84'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:30.758365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efafaac-a5e2-4a84-9067-464ff4836c1f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:30.765344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f7ca1f7a5d4049a13102ed00629c9a', 'request_id': 'req-fdaca04c-8a52-4ee5-99c3-830490501e84'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:30.781461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] The token cache is being invalidate because project b8f7ca1f7a5d4049a13102ed00629c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:30.781757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:30.782877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-fdaca04c-8a52-4ee5-99c3-830490501e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:30.784644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1166/2317] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:30 2022] DELETE /identity/v3/projects/b8f7ca1f7a5d4049a13102ed00629c9a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:30.785923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:30.786278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:30.786741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:30.811970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:30.814648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:30.853026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:30.853352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:30.853744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:30.854125 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:30.858770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:30.896791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:30.913930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1167/2318] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:30.914852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:30.916875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:30.964564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:30.968127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:30.982217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1152/2319] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:30.983056 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:30.984376 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:31.016723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c5d5-48bf-464b-8709-72e3e8fc34cf None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:31.023169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:31.023985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.024406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.024864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] PATH_INFO: `/v3/users/1cd6b52a9b77479fb8b5009de0a0dd09` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.027047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd6b52a9b77479fb8b5009de0a0dd09)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:31.029335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:31.088523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a2ec6-731d-4486-ae1f-09dcb708e760 service nova] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:31.094546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:31.095399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.095794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.096081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.104581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd6b52a9b77479fb8b5009de0a0dd09'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.109258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:31.111744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:31.123676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1153/2320] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:48:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:48:31.124208 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd6b52a9b77479fb8b5009de0a0dd09'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.125382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd6b52a9b77479fb8b5009de0a0dd09'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.135352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd6b52a9b77479fb8b5009de0a0dd09'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.144301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d3ce66a4-fff5-4f26-b783-3a4a25e22e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd6b52a9b77479fb8b5009de0a0dd09'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.160521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1168/2321] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:30 2022] DELETE /identity/v3/users/1cd6b52a9b77479fb8b5009de0a0dd09 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:31.426222 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:31.448336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74bc4b-1e38-426f-9969-37e89f08b5e4 service swift] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:31.550596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:31.551759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.552046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.552331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] PATH_INFO: `/v3/projects/85a7147989304f9dabde19e6857fb3b0` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.553544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a7147989304f9dabde19e6857fb3b0)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:31.555828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:31.617194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a7147989304f9dabde19e6857fb3b0', 'request_id': 'req-b249ae6c-5311-4030-97bc-16dd6a9c81b1'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.619812 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:31.624141 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a7147989304f9dabde19e6857fb3b0', 'request_id': 'req-b249ae6c-5311-4030-97bc-16dd6a9c81b1'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.634443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a7147989304f9dabde19e6857fb3b0', 'request_id': 'req-b249ae6c-5311-4030-97bc-16dd6a9c81b1'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.646940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] The token cache is being invalidate because project 85a7147989304f9dabde19e6857fb3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:31.647280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.648170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b249ae6c-5311-4030-97bc-16dd6a9c81b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:31.649692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1154/2322] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:31 2022] DELETE /identity/v3/projects/85a7147989304f9dabde19e6857fb3b0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:31.654593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bbb9-b0e2-4236-abda-e6723ff1dd93 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.655073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bbb9-b0e2-4236-abda-e6723ff1dd93 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.655168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bbb9-b0e2-4236-abda-e6723ff1dd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.662348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:31.679395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2664bbb9-b0e2-4236-abda-e6723ff1dd93 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:31.681016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2664bbb9-b0e2-4236-abda-e6723ff1dd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:31.744629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1169/2323] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:31.752278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035785d-860a-495f-937b-861d1df9fa33 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.752569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035785d-860a-495f-937b-861d1df9fa33 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.752849 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035785d-860a-495f-937b-861d1df9fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.777512 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4035785d-860a-495f-937b-861d1df9fa33 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:31.778748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4035785d-860a-495f-937b-861d1df9fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:31.787702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1155/2324] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:31.791936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664bbb9-b0e2-4236-abda-e6723ff1dd93 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:31.801965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664bbb9-b0e2-4236-abda-e6723ff1dd93 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:31.806626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826ac51-0d89-4ef5-b6d8-1a3168c2d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:31.807434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ac51-0d89-4ef5-b6d8-1a3168c2d86b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.807791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ac51-0d89-4ef5-b6d8-1a3168c2d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.808074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ac51-0d89-4ef5-b6d8-1a3168c2d86b admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.808809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826ac51-0d89-4ef5-b6d8-1a3168c2d86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:31.809216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826ac51-0d89-4ef5-b6d8-1a3168c2d86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:31.810917 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826ac51-0d89-4ef5-b6d8-1a3168c2d86b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:31.824512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1170/2325] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:31.828546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035785d-860a-495f-937b-861d1df9fa33 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:31.843053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035785d-860a-495f-937b-861d1df9fa33 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:31.848342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:31.849086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.849272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.849552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.850243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:31.852200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:31.879409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ae6a-5cdd-41b7-95da-89df6f474cf7 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.879758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ae6a-5cdd-41b7-95da-89df6f474cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.880090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ae6a-5cdd-41b7-95da-89df6f474cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.886485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1156/2326] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:31 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:31.891140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:31.910185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f5d6ae6a-5cdd-41b7-95da-89df6f474cf7 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:31.911882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f5d6ae6a-5cdd-41b7-95da-89df6f474cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:31.973044 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061c5e-9a02-4d27-9bb3-5df9e8ec8a6f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:31.978818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:31.979572 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:31.979891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:31.980175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:31.980925 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:31.982971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:31.995350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1171/2327] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 23 13:48:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:32.007293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1157/2328] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:31 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:32.011726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ae6a-5cdd-41b7-95da-89df6f474cf7 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:32.012645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:32.014555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:32.023590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ae6a-5cdd-41b7-95da-89df6f474cf7 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:32.028299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:32.028972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.029273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.029543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.030380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:32.031921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:32.042381 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1172/2329] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:32.046218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:32.060814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79910c-165c-4b37-aa81-7a5f9899c946 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:32.061761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:32.062416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.063091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.063091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.063907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:32.065497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:32.076262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1173/2330] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:32.080069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:32.090006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6df75-4d37-40d1-8af9-41492cb02ddd admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:32.094722 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:32.095619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.095912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.096197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] PATH_INFO: `/v3/projects/8d3388df06f142719e4a78847488545b/users/c1901143912b43229d10e1064e4fbe41/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.097037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5cbb-537b-4bd2-8309-964da3d53af1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:32.102151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47dbb7-bb74-4169-b19f-0b87a3573b1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:32.102800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47dbb7-bb74-4169-b19f-0b87a3573b1a service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.103092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47dbb7-bb74-4169-b19f-0b87a3573b1a service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.103411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47dbb7-bb74-4169-b19f-0b87a3573b1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.112021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3388df06f142719e4a78847488545b, user_id=c1901143912b43229d10e1064e4fbe41, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:32.112331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47dbb7-bb74-4169-b19f-0b87a3573b1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:32.113901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47dbb7-bb74-4169-b19f-0b87a3573b1a service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:32.114973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:32.122321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1158/2331] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:48:32.129943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1174/2332] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:32 2022] PUT /identity/v3/projects/8d3388df06f142719e4a78847488545b/users/c1901143912b43229d10e1064e4fbe41/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:32.197898 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8550f-80ad-419a-96c7-4e6b01992bc0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.198728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8550f-80ad-419a-96c7-4e6b01992bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.199021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8550f-80ad-419a-96c7-4e6b01992bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.226065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8ec8550f-80ad-419a-96c7-4e6b01992bc0 None None] MFA Rules not processed for user `c1901143912b43229d10e1064e4fbe41`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:32.228018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8ec8550f-80ad-419a-96c7-4e6b01992bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:32.250502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:32.308553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1159/2333] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:32.321123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:32.324325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:32.355407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f7a4-2b15-4f77-b12b-ac64496e334f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.355700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f7a4-2b15-4f77-b12b-ac64496e334f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.355985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f7a4-2b15-4f77-b12b-ac64496e334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.376018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9528f7a4-2b15-4f77-b12b-ac64496e334f None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:32.377478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9528f7a4-2b15-4f77-b12b-ac64496e334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:32.383829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:32.389760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf47910-de2b-4786-b78e-c4f716f72b1e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:32.394632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:32.395322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.395607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.395883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.413035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:32.413035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:32.420283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1175/2334] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:32.438268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1160/2335] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:32.451974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:32.533928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc523e-d2aa-4aa9-b04b-b080fc310d6f service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:32.540498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:32.541104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:32.541395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:32.541709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:32.556659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:32.558372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:32.570980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1176/2336] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:48:33.006041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.006506 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.006597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.024031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:33.025212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:33.032690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1161/2337] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 23 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:33.045046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:33.055602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad153d4f-2b90-4a6a-a250-74b2f2c65f07 service swift] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:33.060745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6681884-a365-499b-88a4-1b645d62741c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:33.061379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681884-a365-499b-88a4-1b645d62741c service swift] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:33.061670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681884-a365-499b-88a4-1b645d62741c service swift] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:33.061954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681884-a365-499b-88a4-1b645d62741c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:33.071532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6681884-a365-499b-88a4-1b645d62741c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:33.073147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6681884-a365-499b-88a4-1b645d62741c service swift] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:33.081907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1177/2338] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:48:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:48:35.305713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.307303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:35.412384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14fbaf-6ced-42f5-b7fa-32533f6b9f34 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.427337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.428474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.431608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.432130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] PATH_INFO: `/v3/users/793f6cefd07b4150be2d2f647a283d15` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.435593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=793f6cefd07b4150be2d2f647a283d15)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.439384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.514043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793f6cefd07b4150be2d2f647a283d15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:35.527948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:35.533637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793f6cefd07b4150be2d2f647a283d15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:35.547705 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793f6cefd07b4150be2d2f647a283d15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:35.557018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793f6cefd07b4150be2d2f647a283d15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:35.557996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793f6cefd07b4150be2d2f647a283d15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:35.565133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1162/2339] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:35 2022] DELETE /identity/v3/users/793f6cefd07b4150be2d2f647a283d15 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:35.569421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.570267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.570905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.592374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:35.593739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:35.662014 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1178/2340] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:35.672390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.674682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:35.757213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133e176-4fa0-4473-a1bf-1d9cee9e74ac admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.761390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbf1fc-e3e2-4211-b0a2-fe30c26c1c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.762082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf1fc-e3e2-4211-b0a2-fe30c26c1c6b service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.762375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf1fc-e3e2-4211-b0a2-fe30c26c1c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.762660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbf1fc-e3e2-4211-b0a2-fe30c26c1c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.772350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbf1fc-e3e2-4211-b0a2-fe30c26c1c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.774103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbf1fc-e3e2-4211-b0a2-fe30c26c1c6b service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:35.786503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1163/2341] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:35.971734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:35.973727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:35.986178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a59a3-b546-4317-9007-eed660e4f6d4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:35.990734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:35.992017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:35.992311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:35.992594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] PATH_INFO: `/v3/projects/af09af590bd549e4a6bda5a501f18fb2` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:35.993948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af09af590bd549e4a6bda5a501f18fb2)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:35.996598 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:36.043371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af09af590bd549e4a6bda5a501f18fb2', 'request_id': 'req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:36.049581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af09af590bd549e4a6bda5a501f18fb2', 'request_id': 'req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:36.053165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:36.058339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af09af590bd549e4a6bda5a501f18fb2', 'request_id': 'req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:36.071636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] The token cache is being invalidate because project af09af590bd549e4a6bda5a501f18fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:36.071933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:36.072599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:36.074801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1179/2342] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:35 2022] DELETE /identity/v3/projects/af09af590bd549e4a6bda5a501f18fb2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:40.669353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de63e7-4d88-499c-a4d3-5e340d96a135 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:40.669894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de63e7-4d88-499c-a4d3-5e340d96a135 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:40.669894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de63e7-4d88-499c-a4d3-5e340d96a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:40.688770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f1de63e7-4d88-499c-a4d3-5e340d96a135 None None] MFA Rules not processed for user `cb2e8212194a4b56a6897702bd306b53`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:40.690088 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f1de63e7-4d88-499c-a4d3-5e340d96a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:40.774893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1164/2343] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:42.261369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:42.265043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:42.336950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d2ff-d05b-4d3f-b1bd-2eb6ce872784 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:42.342069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:42.342988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:42.343309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:42.343595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] PATH_INFO: `/v3/users/85cd4fb380ca4fc3b7cea2004041aa76` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:42.344795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cd4fb380ca4fc3b7cea2004041aa76)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:42.346737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:42.398340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cd4fb380ca4fc3b7cea2004041aa76'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.410577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cd4fb380ca4fc3b7cea2004041aa76'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.411282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cd4fb380ca4fc3b7cea2004041aa76'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.418596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cd4fb380ca4fc3b7cea2004041aa76'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.425391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cd4fb380ca4fc3b7cea2004041aa76'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:42.431226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1180/2344] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:42 2022] DELETE /identity/v3/users/85cd4fb380ca4fc3b7cea2004041aa76 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:42.435643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:42.436095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:42.436184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:42.453762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:42.454949 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:42.519704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1165/2345] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:42.529786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:42.531231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:42.599100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e60462-6504-4030-a705-b1f2f0adb674 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:42.602875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e8bb-1e17-4cd4-91f9-ddb1ea614a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:42.603633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e8bb-1e17-4cd4-91f9-ddb1ea614a40 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:42.604582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e8bb-1e17-4cd4-91f9-ddb1ea614a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:42.605317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e8bb-1e17-4cd4-91f9-ddb1ea614a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:42.619991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e8bb-1e17-4cd4-91f9-ddb1ea614a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:42.621815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e8bb-1e17-4cd4-91f9-ddb1ea614a40 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:42.634226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1181/2346] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:42.987423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:42.988854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.001307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cae6e-1713-4a06-8b35-02d3533876fc None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.006398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.007304 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.007592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.007868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] PATH_INFO: `/v3/projects/dcef2b3be23d47e985b737285074ff70` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.009697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcef2b3be23d47e985b737285074ff70)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.011802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.034491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:43.059019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcef2b3be23d47e985b737285074ff70', 'request_id': 'req-d0f5965e-4279-4e81-aceb-33779e1500f4'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.065097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcef2b3be23d47e985b737285074ff70', 'request_id': 'req-d0f5965e-4279-4e81-aceb-33779e1500f4'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.072145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcef2b3be23d47e985b737285074ff70', 'request_id': 'req-d0f5965e-4279-4e81-aceb-33779e1500f4'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.083469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] The token cache is being invalidate because project dcef2b3be23d47e985b737285074ff70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:43.083776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.084410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.085934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1166/2347] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:42 2022] DELETE /identity/v3/projects/dcef2b3be23d47e985b737285074ff70 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:43.091648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a95e1-6ec8-42f8-b0ea-5996a50c436e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.091936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a95e1-6ec8-42f8-b0ea-5996a50c436e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.092214 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a95e1-6ec8-42f8-b0ea-5996a50c436e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.109233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0e4a95e1-6ec8-42f8-b0ea-5996a50c436e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:43.110408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0e4a95e1-6ec8-42f8-b0ea-5996a50c436e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.118637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:43.144346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.145799 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.177375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1182/2348] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:43.185079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d325a-70b1-4ba8-9484-4b7904b25f1a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.185498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d325a-70b1-4ba8-9484-4b7904b25f1a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.185826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d325a-70b1-4ba8-9484-4b7904b25f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.206139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-848d325a-70b1-4ba8-9484-4b7904b25f1a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:43.207351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-848d325a-70b1-4ba8-9484-4b7904b25f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.215885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1183/2349] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:43.217455 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5965e-4279-4e81-aceb-33779e1500f4 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.219975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d325a-70b1-4ba8-9484-4b7904b25f1a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.222603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.223500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.223784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.224090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] PATH_INFO: `/v3/users/c1901143912b43229d10e1064e4fbe41` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.225271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1901143912b43229d10e1064e4fbe41)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.227193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.229120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d325a-70b1-4ba8-9484-4b7904b25f1a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.234266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.234992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.235308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.235589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.236314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:43.236621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.238237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.254130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1184/2350] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:48:43.255401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.268237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38946000-492d-497b-b2c0-d4e21b093f9a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.273620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.274345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.274694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.275039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.275871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.277837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.281952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1901143912b43229d10e1064e4fbe41'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.296932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1901143912b43229d10e1064e4fbe41'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.306015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1901143912b43229d10e1064e4fbe41'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.310182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1185/2351] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:43 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:43.314882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.317692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1901143912b43229d10e1064e4fbe41'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.318355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-bea94ed0-8d39-4adc-a9e6-3399f903af29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1901143912b43229d10e1064e4fbe41'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:43.327426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1167/2352] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:43 2022] DELETE /identity/v3/users/c1901143912b43229d10e1064e4fbe41 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:43.329881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.330170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.330451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.347608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:43.348811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.377972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:43.394588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2377ae-a3f0-4aba-baba-118cb943a38d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.419244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1168/2353] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:43.427066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.428436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.451811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.452484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.452773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.453060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.453744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.455737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.477045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1186/2354] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:43 2022] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:43.485415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.487343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.487854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8140b36-e850-4471-a9d0-a5a0a833a449 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.491666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.492312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.492599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.492878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.499491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650922-46d3-4654-9bbf-19786e1344e3 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.503250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.504042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.504687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.504939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.505049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.505237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.505957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.507603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.509828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:43.516672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1169/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:43.522984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1187/2356] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:43.524121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.533545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e4e3-78a8-4631-98bf-e5e201a2a60f service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.538197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9c38a-03a9-4b81-8767-b3a05b35abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.538881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9c38a-03a9-4b81-8767-b3a05b35abf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.539169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9c38a-03a9-4b81-8767-b3a05b35abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.539485 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9c38a-03a9-4b81-8767-b3a05b35abf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.540205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9c38a-03a9-4b81-8767-b3a05b35abf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.541835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9c38a-03a9-4b81-8767-b3a05b35abf7 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.552009 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1170/2357] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:43.555937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.566732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3fe9a-5141-4647-94ca-9c7aef44262b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.572073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.573507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.573793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.574074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] PATH_INFO: `/v3/projects/40b3e0bc01064ffd8c2da577895f1de2/users/f4e2bd55cad346768fe66c3f23ded22c/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.590980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b3e0bc01064ffd8c2da577895f1de2, user_id=f4e2bd55cad346768fe66c3f23ded22c, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.593670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.607568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1188/2358] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:43 2022] PUT /identity/v3/projects/40b3e0bc01064ffd8c2da577895f1de2/users/f4e2bd55cad346768fe66c3f23ded22c/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:48:43.618851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.619172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.619520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.646083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] MFA Rules not processed for user `f4e2bd55cad346768fe66c3f23ded22c`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:43.647323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.725166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1171/2359] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:43.736736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.738460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.816498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6343c92-d757-4624-a6f3-bfe4198dc090 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.820584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.821244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.821532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.821815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.830834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.832344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.841930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1189/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:43.867558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.869082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:43.871860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:43.935019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:43.950883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e84ca-833b-4544-aaab-23031212e670 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.952815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7eae6-7bdb-49c3-b02f-18264e726ae8 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:43.956867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.957750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.958280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.958566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] PATH_INFO: `/v3/users/f4e2bd55cad346768fe66c3f23ded22c` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.959923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e2bd55cad346768fe66c3f23ded22c)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.961990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:43.969034 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:43.971509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:43.971986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:43.972437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] PATH_INFO: `/v3/projects/8d3388df06f142719e4a78847488545b` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:43.975271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3388df06f142719e4a78847488545b)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:43.983133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:44.038352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e2bd55cad346768fe66c3f23ded22c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.053827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3388df06f142719e4a78847488545b', 'request_id': 'req-009c6ab2-5dd6-4dd3-957b-748ba0692c21'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.059658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e2bd55cad346768fe66c3f23ded22c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.060427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e2bd55cad346768fe66c3f23ded22c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.063900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3388df06f142719e4a78847488545b', 'request_id': 'req-009c6ab2-5dd6-4dd3-957b-748ba0692c21'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.068758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e2bd55cad346768fe66c3f23ded22c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.075497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:44.077498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-e85aeeb1-67bb-4413-9a63-74ee49e5f3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e2bd55cad346768fe66c3f23ded22c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.081107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3388df06f142719e4a78847488545b', 'request_id': 'req-009c6ab2-5dd6-4dd3-957b-748ba0692c21'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.087232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1190/2361] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:48:43 2022] DELETE /identity/v3/users/f4e2bd55cad346768fe66c3f23ded22c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:44.092076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:44.092448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:44.092800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:44.100348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] The token cache is being invalidate because project 8d3388df06f142719e4a78847488545b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:44.100674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.101336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.103028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1172/2362] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:43 2022] DELETE /identity/v3/projects/8d3388df06f142719e4a78847488545b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:44.116354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:44.117907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:44.194631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1191/2363] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:44.204584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:44.206093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:44.268916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6ab2-5dd6-4dd3-957b-748ba0692c21 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:44.333817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b042-841f-4b8f-b859-2b18038b367a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:44.334660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b042-841f-4b8f-b859-2b18038b367a service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:44.334957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b042-841f-4b8f-b859-2b18038b367a service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:44.335813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b042-841f-4b8f-b859-2b18038b367a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:44.352484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b042-841f-4b8f-b859-2b18038b367a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:44.354564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b042-841f-4b8f-b859-2b18038b367a service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:44.365866 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1173/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:48:44.760287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:44.761813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:44.776445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cb1e8-bfcf-44f7-bf69-48a0cdc40a93 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:44.781094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:44.782733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:44.783094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:44.783595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] PATH_INFO: `/v3/projects/40b3e0bc01064ffd8c2da577895f1de2` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:44.784787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b3e0bc01064ffd8c2da577895f1de2)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:44.786822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:44.837570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b3e0bc01064ffd8c2da577895f1de2', 'request_id': 'req-09148387-eb74-4ae6-9f51-cddee4f3bc5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.844072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b3e0bc01064ffd8c2da577895f1de2', 'request_id': 'req-09148387-eb74-4ae6-9f51-cddee4f3bc5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.852318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b3e0bc01064ffd8c2da577895f1de2', 'request_id': 'req-09148387-eb74-4ae6-9f51-cddee4f3bc5c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.864827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] The token cache is being invalidate because project 40b3e0bc01064ffd8c2da577895f1de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:48:44.865120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.865760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-09148387-eb74-4ae6-9f51-cddee4f3bc5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:48:44.868690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1192/2365] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:48:44 2022] DELETE /identity/v3/projects/40b3e0bc01064ffd8c2da577895f1de2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:44.872843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a8d1-4a91-403b-93c0-12a3bfc7e3b0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:44.873354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a8d1-4a91-403b-93c0-12a3bfc7e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:44.873456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a8d1-4a91-403b-93c0-12a3bfc7e3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:44.897879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2f08a8d1-4a91-403b-93c0-12a3bfc7e3b0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:44.899095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2f08a8d1-4a91-403b-93c0-12a3bfc7e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:44.936232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:44.965028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1174/2366] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:48:44.973510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33e1b-c8e5-4ab0-82f4-b7cb368fd2f0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:44.973885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33e1b-c8e5-4ab0-82f4-b7cb368fd2f0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:44.974236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33e1b-c8e5-4ab0-82f4-b7cb368fd2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:44.993780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9bb33e1b-c8e5-4ab0-82f4-b7cb368fd2f0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:44.995660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9bb33e1b-c8e5-4ab0-82f4-b7cb368fd2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:45.012065 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1193/2367] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:45.013368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08a8d1-4a91-403b-93c0-12a3bfc7e3b0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.023693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08a8d1-4a91-403b-93c0-12a3bfc7e3b0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.028867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.029758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.030321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.030761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.031701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:48:45.032189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.033981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.049086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1175/2368] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:48:45.053602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb33e1b-c8e5-4ab0-82f4-b7cb368fd2f0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.065166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb33e1b-c8e5-4ab0-82f4-b7cb368fd2f0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.070979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.071819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.072178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.072524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.074016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.076277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.170246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1194/2369] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:45 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:45.174526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.194023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15ad0-4174-45d4-b7be-ad2c61046c1a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.279590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.279953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.280280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.280568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.281294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.284426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.310153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1176/2370] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:45 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:45.314056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.325311 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0922-b51d-4e7d-857b-180f3cf726b3 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.330155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.330916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.331277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.331560 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.332334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.333988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.345178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1195/2371] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:45.349398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.362706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2d4e8-f8db-4c94-8cfe-5d713b56cd15 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.367359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc666a8-88f1-4488-a590-53a27ff1bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.368028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc666a8-88f1-4488-a590-53a27ff1bef3 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.368314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc666a8-88f1-4488-a590-53a27ff1bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.368591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc666a8-88f1-4488-a590-53a27ff1bef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.369323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc666a8-88f1-4488-a590-53a27ff1bef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.371574 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc666a8-88f1-4488-a590-53a27ff1bef3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.381670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1177/2372] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:48:45.385690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.395801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6874b14-7bfc-4e26-a710-7243013e0c91 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.401076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.402069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.402433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.402784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] PATH_INFO: `/v3/projects/493cfa4c715c416eb76f94953f645f43/users/b88e9be988dd4d208aa83447c17fea13/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.419799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493cfa4c715c416eb76f94953f645f43, user_id=b88e9be988dd4d208aa83447c17fea13, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.423002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.439297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1196/2373] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:45 2022] PUT /identity/v3/projects/493cfa4c715c416eb76f94953f645f43/users/b88e9be988dd4d208aa83447c17fea13/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:45.444822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9fd4e-e064-405a-be67-5337b14a1beb None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.445116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9fd4e-e064-405a-be67-5337b14a1beb None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.445393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9fd4e-e064-405a-be67-5337b14a1beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.484348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7fe9fd4e-e064-405a-be67-5337b14a1beb None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:45.485833 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7fe9fd4e-e064-405a-be67-5337b14a1beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:45.577960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1178/2374] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:45.590679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.593290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:45.597137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481dad4-9e11-4b23-9526-67b5ef6ba04f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.597627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481dad4-9e11-4b23-9526-67b5ef6ba04f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.598221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481dad4-9e11-4b23-9526-67b5ef6ba04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.615838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:45.621887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4481dad4-9e11-4b23-9526-67b5ef6ba04f None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:45.623814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4481dad4-9e11-4b23-9526-67b5ef6ba04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:45.671415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ad41e-3d57-4a16-8e54-5ced84c7cd72 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.676047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.676714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.677005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.677289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.692287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.695777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.710696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1197/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:48:45.723033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:45.751576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1179/2376] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:48:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:45.760404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:45.761882 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:45.864676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc53f-f72a-4e4c-a086-e473e031ebdd service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:45.869880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75f2b2-7ebc-438e-a702-28735d3d84d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:45.870533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75f2b2-7ebc-438e-a702-28735d3d84d6 service swift] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:45.870816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75f2b2-7ebc-438e-a702-28735d3d84d6 service swift] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:45.871096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75f2b2-7ebc-438e-a702-28735d3d84d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:45.880074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75f2b2-7ebc-438e-a702-28735d3d84d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:45.881657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75f2b2-7ebc-438e-a702-28735d3d84d6 service swift] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:45.891443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1198/2377] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:48:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:48:52.680496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a02755-67bd-4421-9c43-b147ab37bc3c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:52.681579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a02755-67bd-4421-9c43-b147ab37bc3c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:52.682122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a02755-67bd-4421-9c43-b147ab37bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:52.726267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c4a02755-67bd-4421-9c43-b147ab37bc3c None None] MFA Rules not processed for user `3299d3b5a5f14c588ef6e9fb7246b43a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:52.728173 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c4a02755-67bd-4421-9c43-b147ab37bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:52.854980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1180/2378] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:55.887916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=51 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:56.237217 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd0f7-968f-4cad-85a5-d22f08d3fe53 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:56.237580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd0f7-968f-4cad-85a5-d22f08d3fe53 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:56.237790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd0f7-968f-4cad-85a5-d22f08d3fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:56.351704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0d1fd0f7-968f-4cad-85a5-d22f08d3fe53 None None] MFA Rules not processed for user `b88e9be988dd4d208aa83447c17fea13`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:48:56.352977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0d1fd0f7-968f-4cad-85a5-d22f08d3fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:48:56.508840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1199/2379] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:48:56.509235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a02755-67bd-4421-9c43-b147ab37bc3c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:56.590145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a02755-67bd-4421-9c43-b147ab37bc3c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:56.595874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:56.596711 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:56.597108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:56.597623 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:56.598551 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:56.601061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:56.691431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fd0f7-968f-4cad-85a5-d22f08d3fe53 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:56.691842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1181/2380] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:48:56 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:48:56.709025 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fd0f7-968f-4cad-85a5-d22f08d3fe53 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:56.832693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:56.834387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:56.834896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:56.835295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:56.836097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:56.838477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:56.890581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:56.905400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1200/2381] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:48:56 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:48:56.907245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02c77-1df3-4a3c-ab28-1125fd250063 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:56.915997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:56.916738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:56.917123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:56.917300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:56.918049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:56.924842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:56.949390 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1182/2382] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:56.950603 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:56.961066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef0566-280f-40e3-afb2-7b0c80aed67a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:56.968292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:56.969844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:56.969844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:56.969844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] PATH_INFO: `/v3/projects/a4050011a7e741d3bf2f3e53e4f950f6/users/dadf7e20f75145ad92e3410f5bc9c221/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:57.002087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4050011a7e741d3bf2f3e53e4f950f6, user_id=dadf7e20f75145ad92e3410f5bc9c221, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:57.005061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:57.028919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1201/2383] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:56 2022] PUT /identity/v3/projects/a4050011a7e741d3bf2f3e53e4f950f6/users/dadf7e20f75145ad92e3410f5bc9c221/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:48:57.033732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:57.046437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248a645-2159-40aa-887c-7172f4e50493 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:57.138301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68905b1-7148-4cb6-aa0a-9e5df04a58ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:57.139087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68905b1-7148-4cb6-aa0a-9e5df04a58ea admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:57.139478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68905b1-7148-4cb6-aa0a-9e5df04a58ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:57.139828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68905b1-7148-4cb6-aa0a-9e5df04a58ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:57.140655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68905b1-7148-4cb6-aa0a-9e5df04a58ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:57.142509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68905b1-7148-4cb6-aa0a-9e5df04a58ea admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:57.160004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:57.168794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1183/2384] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:48:57.172238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:48:57.188753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfc75b-2027-44c9-9197-6cc44f89e152 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:48:57.195969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:48:57.196945 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:48:57.206075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:48:57.206388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] PATH_INFO: `/v3/projects/a4050011a7e741d3bf2f3e53e4f950f6/users/dadf7e20f75145ad92e3410f5bc9c221/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:48:57.208604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4050011a7e741d3bf2f3e53e4f950f6, user_id=dadf7e20f75145ad92e3410f5bc9c221, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:48:57.211296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:48:57.238664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1202/2385] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:48:57 2022] PUT /identity/v3/projects/a4050011a7e741d3bf2f3e53e4f950f6/users/dadf7e20f75145ad92e3410f5bc9c221/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:49:05.638692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5f71-61e3-4b08-bdf3-c3c4e9294e54 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:05.639364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5f71-61e3-4b08-bdf3-c3c4e9294e54 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:05.639644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5f71-61e3-4b08-bdf3-c3c4e9294e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:05.678622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-656e5f71-61e3-4b08-bdf3-c3c4e9294e54 None None] MFA Rules not processed for user `dadf7e20f75145ad92e3410f5bc9c221`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:05.680195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-656e5f71-61e3-4b08-bdf3-c3c4e9294e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:05.758244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1184/2386] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:49:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:05.772127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:05.774073 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:05.819908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:05.864468 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974873-537b-4a18-9c59-5ccd36a37144 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:05.870395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d606013-1d13-4308-ba87-3d82067774b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:05.871038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606013-1d13-4308-ba87-3d82067774b0 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:05.871347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606013-1d13-4308-ba87-3d82067774b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:05.871625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606013-1d13-4308-ba87-3d82067774b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:05.925699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d606013-1d13-4308-ba87-3d82067774b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:05.927220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d606013-1d13-4308-ba87-3d82067774b0 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:05.936456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1203/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:07.471496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27043-5f70-4b96-ad55-3661b918f776 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:07.472366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27043-5f70-4b96-ad55-3661b918f776 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:07.472962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27043-5f70-4b96-ad55-3661b918f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:07.506856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-bec27043-5f70-4b96-ad55-3661b918f776 None None] MFA Rules not processed for user `b88e9be988dd4d208aa83447c17fea13`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:07.508098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-bec27043-5f70-4b96-ad55-3661b918f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:07.517085 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1185/2388] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:49:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:08.926239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962b52-73d2-400a-8294-7a4dcf187ac7 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:08.926768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962b52-73d2-400a-8294-7a4dcf187ac7 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:08.926768 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962b52-73d2-400a-8294-7a4dcf187ac7 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:08.928915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1204/2389] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:49:08.942537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389ca80-df45-409f-b030-dc1052005b12 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:08.943700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389ca80-df45-409f-b030-dc1052005b12 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:08.944183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389ca80-df45-409f-b030-dc1052005b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.096555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-5389ca80-df45-409f-b030-dc1052005b12 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:09.101773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5389ca80-df45-409f-b030-dc1052005b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:09.136706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1186/2390] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:49:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:09.149176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962b52-73d2-400a-8294-7a4dcf187ac7 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:09.151447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3a962b52-73d2-400a-8294-7a4dcf187ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:09.252526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962b52-73d2-400a-8294-7a4dcf187ac7 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:09.256299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32fbe-d62e-48fa-9937-70aadde43381 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:09.257179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32fbe-d62e-48fa-9937-70aadde43381 service glance] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:09.257462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32fbe-d62e-48fa-9937-70aadde43381 service glance] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:09.257966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32fbe-d62e-48fa-9937-70aadde43381 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.270382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32fbe-d62e-48fa-9937-70aadde43381 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:09.272362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32fbe-d62e-48fa-9937-70aadde43381 service glance] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:09.285404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1205/2391] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:09.360914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27758bd3-9432-4a3d-93a7-3301f5c67b50 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:09.361201 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27758bd3-9432-4a3d-93a7-3301f5c67b50 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:09.361479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27758bd3-9432-4a3d-93a7-3301f5c67b50 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.362893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1187/2392] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:49:09.368521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c6e8d-d633-45ee-b184-ec38310df50e None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:09.368853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c6e8d-d633-45ee-b184-ec38310df50e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:09.369647 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c6e8d-d633-45ee-b184-ec38310df50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.412678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ad2c6e8d-d633-45ee-b184-ec38310df50e None None] MFA Rules not processed for user `45c718c1e1024d73b6b635f77bacdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:09.413958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ad2c6e8d-d633-45ee-b184-ec38310df50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:09.474808 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:09.494142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1206/2393] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:09.507169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27758bd3-9432-4a3d-93a7-3301f5c67b50 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:09.508997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-27758bd3-9432-4a3d-93a7-3301f5c67b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:09.522375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27758bd3-9432-4a3d-93a7-3301f5c67b50 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:09.526910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66257689-41c7-42ee-a402-9f849dc1f040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:09.527591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257689-41c7-42ee-a402-9f849dc1f040 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:09.527883 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257689-41c7-42ee-a402-9f849dc1f040 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:09.528164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257689-41c7-42ee-a402-9f849dc1f040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.535865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66257689-41c7-42ee-a402-9f849dc1f040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:09.537301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66257689-41c7-42ee-a402-9f849dc1f040 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:09.546357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1188/2394] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:09.634042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0d17-3a03-433b-9bc8-c693d754ea34 None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:09.634346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0d17-3a03-433b-9bc8-c693d754ea34 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:09.634667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0d17-3a03-433b-9bc8-c693d754ea34 None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.636126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1207/2395] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:49:09.641490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a713c4-b69d-4c06-8db6-7c84743b898f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:09.641786 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a713c4-b69d-4c06-8db6-7c84743b898f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:09.642070 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a713c4-b69d-4c06-8db6-7c84743b898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.663398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-69a713c4-b69d-4c06-8db6-7c84743b898f None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:09.664610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-69a713c4-b69d-4c06-8db6-7c84743b898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:09.678744 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1189/2396] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:09.689393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f0d17-3a03-433b-9bc8-c693d754ea34 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:09.700367 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f0d17-3a03-433b-9bc8-c693d754ea34 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:09.703878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:09.704514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:09.704802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:09.705082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:09.715633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:09.717253 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:09.730234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1208/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:12.784596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8be5-c8cb-4c40-8872-aaa148449bcd None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:12.784991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8be5-c8cb-4c40-8872-aaa148449bcd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:12.785157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8be5-c8cb-4c40-8872-aaa148449bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:12.804242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-383c8be5-c8cb-4c40-8872-aaa148449bcd None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:12.805813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-383c8be5-c8cb-4c40-8872-aaa148449bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:12.866213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1190/2398] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:49:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:12.878453 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:12.950278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c736d-ef9b-4d7f-857c-2613bad97e3e service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:12.955753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:12.956400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:12.956686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:12.956966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:12.966173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:12.967995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:12.976830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1209/2399] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:49:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:49:13.172498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:13.172805 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:13.173063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:13.262139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:13.263755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:13.300698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:13.380879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1191/2400] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:13.403813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:13.405651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:13.456354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d65dc-37a8-4d2e-aec5-b6d3ac5f5a63 service swift] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:13.461887 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2ab74-3a75-4370-84ed-46e296e0bf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:13.462532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ab74-3a75-4370-84ed-46e296e0bf3f service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:13.462848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ab74-3a75-4370-84ed-46e296e0bf3f service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:13.463132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ab74-3a75-4370-84ed-46e296e0bf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:13.472688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ab74-3a75-4370-84ed-46e296e0bf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:13.474454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ab74-3a75-4370-84ed-46e296e0bf3f service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:13.484980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1210/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:23.372271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=19 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:23.480365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=58 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:27.336427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:27.337868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:27.434334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732901f1-c17a-4ed9-bde3-43ff9922149b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:27.439525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:27.440181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:27.440468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:27.440750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:27.442531 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:27.454704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:27.456318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:27.466242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1192/2402] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:29.792988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98b13-a890-4366-9ce6-089f54814762 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:29.793548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98b13-a890-4366-9ce6-089f54814762 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:29.793649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98b13-a890-4366-9ce6-089f54814762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:29.812827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9bb98b13-a890-4366-9ce6-089f54814762 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:29.814163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9bb98b13-a890-4366-9ce6-089f54814762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:29.824132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1211/2403] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:29.837926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:29.852569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6622227-3d60-411c-9697-be98b8c81251 service placement] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:29.858784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:29.859759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:29.860050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:29.860335 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:29.870568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:29.872526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:29.883753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1193/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:34.971668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538efe5-57e4-47df-a1af-c5f9eab6aad9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:34.972345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538efe5-57e4-47df-a1af-c5f9eab6aad9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:34.972345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538efe5-57e4-47df-a1af-c5f9eab6aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:34.991638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1538efe5-57e4-47df-a1af-c5f9eab6aad9 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:34.993277 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1538efe5-57e4-47df-a1af-c5f9eab6aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:35.002963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1212/2405] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:35.027593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:35.043144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22ccf-71e0-421e-9bb0-32b55c066bed service nova] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:35.049054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:35.049813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.050642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.050642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.061128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:35.062821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:35.076278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1194/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:35.701497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ea251-8184-480f-94fa-ee878c7014e1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.701785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ea251-8184-480f-94fa-ee878c7014e1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.702059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ea251-8184-480f-94fa-ee878c7014e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.720316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-684ea251-8184-480f-94fa-ee878c7014e1 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:35.721511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-684ea251-8184-480f-94fa-ee878c7014e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:35.729032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1213/2407] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 23 13:49:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:35.751923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:35.762941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fede-941c-40f3-aead-a1ad1e8d5cc8 service nova] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:35.767815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862974b1-b846-4509-a395-06f8112b572f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:35.768446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862974b1-b846-4509-a395-06f8112b572f service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:35.768730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862974b1-b846-4509-a395-06f8112b572f service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:35.769007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862974b1-b846-4509-a395-06f8112b572f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:35.777081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862974b1-b846-4509-a395-06f8112b572f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:35.779162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862974b1-b846-4509-a395-06f8112b572f service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:35.786884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1195/2408] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:49:40.241795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413128-23f0-47ae-98b6-ef3a1c802040 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:40.242336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413128-23f0-47ae-98b6-ef3a1c802040 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:40.242484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413128-23f0-47ae-98b6-ef3a1c802040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:40.262091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-12413128-23f0-47ae-98b6-ef3a1c802040 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:40.263463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-12413128-23f0-47ae-98b6-ef3a1c802040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:40.272189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1214/2409] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:40.286606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862974b1-b846-4509-a395-06f8112b572f service swift] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:40.299954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862974b1-b846-4509-a395-06f8112b572f service swift] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:40.307280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9f4e0-07aa-4a8f-8240-e707e07285a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:40.308048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9f4e0-07aa-4a8f-8240-e707e07285a2 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:40.308436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9f4e0-07aa-4a8f-8240-e707e07285a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:40.308841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9f4e0-07aa-4a8f-8240-e707e07285a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:40.319417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9f4e0-07aa-4a8f-8240-e707e07285a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:40.321165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9f4e0-07aa-4a8f-8240-e707e07285a2 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:40.331707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1196/2410] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:41.146454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413128-23f0-47ae-98b6-ef3a1c802040 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:41.157145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413128-23f0-47ae-98b6-ef3a1c802040 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:41.164742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:41.165411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:41.165702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:41.165986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:41.176037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:41.177471 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:41.188249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1215/2411] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:44.436498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e19746-b06b-408a-940e-3f1aaf9c1879 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:44.436961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e19746-b06b-408a-940e-3f1aaf9c1879 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:44.437052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e19746-b06b-408a-940e-3f1aaf9c1879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:44.454886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-70e19746-b06b-408a-940e-3f1aaf9c1879 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:44.456103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-70e19746-b06b-408a-940e-3f1aaf9c1879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:44.463881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1197/2412] 10.222.0.13 () {58 vars in 1016 bytes} [Thu Jun 23 13:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:44.492335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:49:44.505001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572d04-0d0b-4433-a673-4c2785b56ac1 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:49:44.510289 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d438b1-ade2-4d5b-93a3-973f3be491ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:49:44.510915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d438b1-ade2-4d5b-93a3-973f3be491ef service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:44.511226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d438b1-ade2-4d5b-93a3-973f3be491ef service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:44.511508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d438b1-ade2-4d5b-93a3-973f3be491ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:44.519555 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d438b1-ade2-4d5b-93a3-973f3be491ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:49:44.521129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d438b1-ade2-4d5b-93a3-973f3be491ef service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:49:44.530624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1216/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:49:52.209607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:49:52.210151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:49:52.210151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:49:52.227851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] MFA Rules not processed for user `c468cd8df1564441935e4edfba55ccc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:49:52.229042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:49:52.284065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1198/2414] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:49:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:49:54.526424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=24 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:02.276825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:14.606140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319beca-b847-48a7-bce6-e8829ea456c1 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:14.606658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319beca-b847-48a7-bce6-e8829ea456c1 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:14.606753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319beca-b847-48a7-bce6-e8829ea456c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:14.624091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-5319beca-b847-48a7-bce6-e8829ea456c1 None None] MFA Rules not processed for user `cb2e8212194a4b56a6897702bd306b53`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:14.625350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5319beca-b847-48a7-bce6-e8829ea456c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:14.680711 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1217/2415] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:15.799722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:15.801189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:15.816232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f83cf1-1ce6-4fda-b3bd-aea40672978d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:15.820760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:15.821624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:15.821907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:15.822184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] PATH_INFO: `/v3/users/3299d3b5a5f14c588ef6e9fb7246b43a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:15.823372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3299d3b5a5f14c588ef6e9fb7246b43a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:15.825276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:15.871400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3299d3b5a5f14c588ef6e9fb7246b43a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:15.883461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3299d3b5a5f14c588ef6e9fb7246b43a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:15.890564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3299d3b5a5f14c588ef6e9fb7246b43a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:15.897324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3299d3b5a5f14c588ef6e9fb7246b43a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:15.897894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3aa309b-34b2-49f9-9ae7-ea0d6834abf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3299d3b5a5f14c588ef6e9fb7246b43a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:15.903969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1199/2416] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:50:15 2022] DELETE /identity/v3/users/3299d3b5a5f14c588ef6e9fb7246b43a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:16.072151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319beca-b847-48a7-bce6-e8829ea456c1 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.087116 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319beca-b847-48a7-bce6-e8829ea456c1 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.146957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.147919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.148395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.148676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] PATH_INFO: `/v3/projects/f8296259ba704d898035048559e0b3b8` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.149872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8296259ba704d898035048559e0b3b8)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.151825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.207119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8296259ba704d898035048559e0b3b8', 'request_id': 'req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:16.215244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8296259ba704d898035048559e0b3b8', 'request_id': 'req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:16.225028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8296259ba704d898035048559e0b3b8', 'request_id': 'req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:16.244263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] The token cache is being invalidate because project f8296259ba704d898035048559e0b3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:50:16.244566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:16.245254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9344ed12-0df3-4a0a-9b28-7d5608e3f2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:16.248633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1218/2417] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:50:16 2022] DELETE /identity/v3/projects/f8296259ba704d898035048559e0b3b8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:16.254081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7302d-0c7b-4725-89c6-e170631f5e1c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.254380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7302d-0c7b-4725-89c6-e170631f5e1c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.254664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7302d-0c7b-4725-89c6-e170631f5e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.274150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-acf7302d-0c7b-4725-89c6-e170631f5e1c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:16.275448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-acf7302d-0c7b-4725-89c6-e170631f5e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:16.348577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1200/2418] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:16.356227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2e1-d003-4e2b-a2f4-4a8f0e462f67 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.356515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2e1-d003-4e2b-a2f4-4a8f0e462f67 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.356793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2e1-d003-4e2b-a2f4-4a8f0e462f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.375322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-38a2e2e1-d003-4e2b-a2f4-4a8f0e462f67 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:16.376516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-38a2e2e1-d003-4e2b-a2f4-4a8f0e462f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:16.384351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1219/2419] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:16.388517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7302d-0c7b-4725-89c6-e170631f5e1c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.399237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7302d-0c7b-4725-89c6-e170631f5e1c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.404219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.405068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.405352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.405632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.406388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:50:16.406698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.408415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.420411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1201/2420] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:50:16.424612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e2e1-d003-4e2b-a2f4-4a8f0e462f67 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.433624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e2e1-d003-4e2b-a2f4-4a8f0e462f67 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.444127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.444792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.445076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.445355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.446049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.448002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.474401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1220/2421] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:50:16 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:50:16.478636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.489116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5681cb-72b4-4026-bbcb-52f5ba7430ea admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.544715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.545871 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.546164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.546433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.547110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.549053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.555452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:16.572879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1202/2422] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:50:16 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:50:16.574071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.584230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b64f-918d-445b-878d-0cfa20e9d78d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.588769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.589412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.589696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.589976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.590690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.592298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.593514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:16.604235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1221/2423] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:50:16.608174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.618064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7817-eb67-41c0-bd55-5f2835c3c9f9 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.622716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8da29f-7ee2-428a-84b5-47ab16d43159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.623920 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8da29f-7ee2-428a-84b5-47ab16d43159 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.624284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8da29f-7ee2-428a-84b5-47ab16d43159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.624567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8da29f-7ee2-428a-84b5-47ab16d43159 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.625291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8da29f-7ee2-428a-84b5-47ab16d43159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.626881 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8da29f-7ee2-428a-84b5-47ab16d43159 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.636650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1203/2424] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:50:16.640499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.650562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049df35-3784-4b82-b78e-833d841f8129 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.655061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.655947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.656227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.656498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] PATH_INFO: `/v3/projects/02529115e5f549559c97d41bf24206a5/users/b774ed81355848eab8ac41512fb50a23/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.670895 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02529115e5f549559c97d41bf24206a5, user_id=b774ed81355848eab8ac41512fb50a23, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.673574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.685994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1222/2425] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:50:16 2022] PUT /identity/v3/projects/02529115e5f549559c97d41bf24206a5/users/b774ed81355848eab8ac41512fb50a23/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:50:16.696272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce7fe1-4dfd-4a79-9f8e-da488388d097 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.696555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce7fe1-4dfd-4a79-9f8e-da488388d097 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.696840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce7fe1-4dfd-4a79-9f8e-da488388d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.723689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-25ce7fe1-4dfd-4a79-9f8e-da488388d097 None None] MFA Rules not processed for user `b774ed81355848eab8ac41512fb50a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:16.724886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-25ce7fe1-4dfd-4a79-9f8e-da488388d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:16.787598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1204/2426] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:16.798602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:16.800378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:16.878420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c65d-42d6-469b-af61-7d1c073ff393 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:16.882242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:16.882913 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:16.883194 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:16.883500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:16.892433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:16.893876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:16.902800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1223/2427] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:24.577120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13e022-044e-4a35-97cd-ebc5e6be4cd8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:24.577665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13e022-044e-4a35-97cd-ebc5e6be4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:24.577765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13e022-044e-4a35-97cd-ebc5e6be4cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:24.595700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-8f13e022-044e-4a35-97cd-ebc5e6be4cd8 None None] MFA Rules not processed for user `409a723e3fe148e0aded87cbe5f5e254`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:24.596899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8f13e022-044e-4a35-97cd-ebc5e6be4cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:24.649158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1205/2428] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:26.898829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:26.959449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:27.029599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdd0b-abe4-4655-a772-57288f63e181 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:27.034181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:27.035055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:27.035375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:27.035650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] PATH_INFO: `/v3/users/b774ed81355848eab8ac41512fb50a23` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:27.036829 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b774ed81355848eab8ac41512fb50a23)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:27.038792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:27.087431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b774ed81355848eab8ac41512fb50a23'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.100674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b774ed81355848eab8ac41512fb50a23'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.101372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b774ed81355848eab8ac41512fb50a23'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.109588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b774ed81355848eab8ac41512fb50a23'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.118756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b774ed81355848eab8ac41512fb50a23'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.128056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1224/2429] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:50:26 2022] DELETE /identity/v3/users/b774ed81355848eab8ac41512fb50a23 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:27.132609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:27.133192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:27.133363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:27.152636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:27.153986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:27.216563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1206/2430] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:50:27.226554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:27.227969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:27.287900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5e3c7-d509-4b24-9144-b9913598a23e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:27.292439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaa98a-e3b2-45f5-86bc-5e5160324d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:27.293128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaa98a-e3b2-45f5-86bc-5e5160324d56 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:27.293405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaa98a-e3b2-45f5-86bc-5e5160324d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:27.293688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaa98a-e3b2-45f5-86bc-5e5160324d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:27.303111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbaa98a-e3b2-45f5-86bc-5e5160324d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:27.305373 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbaa98a-e3b2-45f5-86bc-5e5160324d56 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:27.320076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1225/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:50:27.642522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:27.646302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:27.673046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72219e5-26b9-4c29-ae74-3f0e7dd1d3a8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:27.681544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:27.682686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:27.684200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:27.684643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] PATH_INFO: `/v3/projects/02529115e5f549559c97d41bf24206a5` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:27.686557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=02529115e5f549559c97d41bf24206a5)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:27.688773 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:27.719493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:27.784940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02529115e5f549559c97d41bf24206a5', 'request_id': 'req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.791893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02529115e5f549559c97d41bf24206a5', 'request_id': 'req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.803315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02529115e5f549559c97d41bf24206a5', 'request_id': 'req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.815025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] The token cache is being invalidate because project 02529115e5f549559c97d41bf24206a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:50:27.815428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.816081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4d3ec723-4bc4-4358-bfd5-bf49753ea3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:27.817867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1207/2432] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:50:27 2022] DELETE /identity/v3/projects/02529115e5f549559c97d41bf24206a5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:27.822491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadc40-890d-4cd0-844f-03a1433d2733 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:27.822785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadc40-890d-4cd0-844f-03a1433d2733 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:27.823072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadc40-890d-4cd0-844f-03a1433d2733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:27.846035 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-82eadc40-890d-4cd0-844f-03a1433d2733 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:27.847307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-82eadc40-890d-4cd0-844f-03a1433d2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:27.868625 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:27.918110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1226/2433] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:27.926465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f1eab-c913-48ea-bb5b-a5b6a7ad9048 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:27.926704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f1eab-c913-48ea-bb5b-a5b6a7ad9048 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:27.927002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f1eab-c913-48ea-bb5b-a5b6a7ad9048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:27.946039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a89f1eab-c913-48ea-bb5b-a5b6a7ad9048 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:27.947277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a89f1eab-c913-48ea-bb5b-a5b6a7ad9048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:27.955710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1208/2434] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:27.959535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eadc40-890d-4cd0-844f-03a1433d2733 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:27.969286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eadc40-890d-4cd0-844f-03a1433d2733 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:27.973896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:27.974554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:27.974845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:27.975128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:27.975884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:50:27.976197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:27.977795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:27.990366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1227/2435] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:50:27.994476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f1eab-c913-48ea-bb5b-a5b6a7ad9048 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:28.004263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f1eab-c913-48ea-bb5b-a5b6a7ad9048 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:28.008848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:28.009507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.009792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.010069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.010754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:28.012704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:28.042049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1209/2436] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:50:27 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:50:28.043266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:28.054061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d00fa-ec4f-45c9-869a-f70309054476 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:28.111330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:28.112005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.112293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.112582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.113263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:28.115178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:28.136019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1228/2437] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:50:28 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:50:28.140796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:28.151339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20767f76-e2ee-4aef-81fd-b09b9b102811 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:28.155889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:28.156538 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.156828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.157104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.157821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:28.159449 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:28.169528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1210/2438] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:50:28.173296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:28.183233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dbfd7-cd6d-4305-8405-223596f601b5 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:28.188432 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b5c40-2b85-4ad5-93e6-b10e516f5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:28.189087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b5c40-2b85-4ad5-93e6-b10e516f5079 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.189376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b5c40-2b85-4ad5-93e6-b10e516f5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.189664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b5c40-2b85-4ad5-93e6-b10e516f5079 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.190387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b5c40-2b85-4ad5-93e6-b10e516f5079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:28.192024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b5c40-2b85-4ad5-93e6-b10e516f5079 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:28.201830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1229/2439] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:50:28.206259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:28.216221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb552d-d4d2-46a3-824f-646424794b7e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:28.220916 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:28.221967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.222262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.222542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] PATH_INFO: `/v3/projects/a78255a15b204469a5c823e3606bce70/users/5061d8c44e0546abaa9f6858903538a6/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.236766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78255a15b204469a5c823e3606bce70, user_id=5061d8c44e0546abaa9f6858903538a6, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:28.239425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:28.253014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1211/2440] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:50:28 2022] PUT /identity/v3/projects/a78255a15b204469a5c823e3606bce70/users/5061d8c44e0546abaa9f6858903538a6/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:28.262996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbfb4-5523-44f9-b6b1-13226e16faf4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.263333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbfb4-5523-44f9-b6b1-13226e16faf4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.263628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbfb4-5523-44f9-b6b1-13226e16faf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.290201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9e1fbfb4-5523-44f9-b6b1-13226e16faf4 None None] MFA Rules not processed for user `5061d8c44e0546abaa9f6858903538a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:28.291518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9e1fbfb4-5523-44f9-b6b1-13226e16faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:28.356674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1230/2441] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:28.367826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:28.369544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:28.424823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bcb92-c4f6-46f0-8062-7a8a7b60aa0c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:28.428429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7a321-9ee4-44cb-a4ae-3a8065dc8d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:28.429063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7a321-9ee4-44cb-a4ae-3a8065dc8d7b service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:28.429347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7a321-9ee4-44cb-a4ae-3a8065dc8d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:28.429622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7a321-9ee4-44cb-a4ae-3a8065dc8d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:28.438287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7a321-9ee4-44cb-a4ae-3a8065dc8d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:28.439811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7a321-9ee4-44cb-a4ae-3a8065dc8d7b service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:28.448287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1212/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:33.396185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbfb4-5523-44f9-b6b1-13226e16faf4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:33.414531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:33.459279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbfb4-5523-44f9-b6b1-13226e16faf4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:33.463909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:33.464772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:33.465053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:33.465336 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] PATH_INFO: `/v3/users/5061d8c44e0546abaa9f6858903538a6` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:33.466586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5061d8c44e0546abaa9f6858903538a6)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:33.468547 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:33.524572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5061d8c44e0546abaa9f6858903538a6'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:33.537828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5061d8c44e0546abaa9f6858903538a6'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:33.538937 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5061d8c44e0546abaa9f6858903538a6'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:33.547762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5061d8c44e0546abaa9f6858903538a6'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:33.556616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5061d8c44e0546abaa9f6858903538a6'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:33.564492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1231/2443] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:50:33 2022] DELETE /identity/v3/users/5061d8c44e0546abaa9f6858903538a6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:33.569294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:33.569911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:33.569911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:33.587305 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:33.588780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:33.639003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:33.682195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1213/2444] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:50:33.696159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:33.697798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:33.762954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6a08-d7f3-4412-85a5-902d2d1fe0e9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:33.767195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ec1c4-ed82-410e-9458-de79e8ed0c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:33.768023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ec1c4-ed82-410e-9458-de79e8ed0c5d service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:33.768369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ec1c4-ed82-410e-9458-de79e8ed0c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:33.768650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ec1c4-ed82-410e-9458-de79e8ed0c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:33.778466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ec1c4-ed82-410e-9458-de79e8ed0c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:33.779971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ec1c4-ed82-410e-9458-de79e8ed0c5d service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:33.790095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1232/2445] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:50:34.128245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:50:34.129700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:34.141346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e2d1c-a27f-488f-ab5d-1195111e1eb3 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:50:34.146716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:50:34.147642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:34.147926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:34.148465 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] PATH_INFO: `/v3/projects/a78255a15b204469a5c823e3606bce70` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:34.149689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78255a15b204469a5c823e3606bce70)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:50:34.151665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:50:34.199979 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78255a15b204469a5c823e3606bce70', 'request_id': 'req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:34.206069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78255a15b204469a5c823e3606bce70', 'request_id': 'req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:34.212802 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78255a15b204469a5c823e3606bce70', 'request_id': 'req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:34.224089 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] The token cache is being invalidate because project a78255a15b204469a5c823e3606bce70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:50:34.224379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:34.225059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:50:34.226614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1214/2446] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:50:34 2022] DELETE /identity/v3/projects/a78255a15b204469a5c823e3606bce70 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:50:43.785771 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:44.220699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:53.705326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777418-8618-4d25-ad41-352e0ee48920 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:50:53.706236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777418-8618-4d25-ad41-352e0ee48920 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:50:53.706504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777418-8618-4d25-ad41-352e0ee48920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:50:53.724031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-f7777418-8618-4d25-ad41-352e0ee48920 None None] MFA Rules not processed for user `c468cd8df1564441935e4edfba55ccc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:50:53.725286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f7777418-8618-4d25-ad41-352e0ee48920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:50:53.783196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1233/2447] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:50:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:03.776591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=25 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:17.378977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:17.383477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:17.451033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a7d58-fa76-455d-8cb3-2b4580c7d94d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:17.456416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:17.457275 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:17.457562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:17.457841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] PATH_INFO: `/v3/users/cb2e8212194a4b56a6897702bd306b53` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:17.459027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2e8212194a4b56a6897702bd306b53)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:17.461020 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:17.512409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2e8212194a4b56a6897702bd306b53'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.524981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2e8212194a4b56a6897702bd306b53'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.534669 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2e8212194a4b56a6897702bd306b53'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.542565 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2e8212194a4b56a6897702bd306b53'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.543259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3cf0bc89-ea08-4483-8ded-8dd09921f090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2e8212194a4b56a6897702bd306b53'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.550167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1215/2448] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:17 2022] DELETE /identity/v3/users/cb2e8212194a4b56a6897702bd306b53 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:17.724982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777418-8618-4d25-ad41-352e0ee48920 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:17.736559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777418-8618-4d25-ad41-352e0ee48920 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:17.793379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:17.794238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:17.794527 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:17.794809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] PATH_INFO: `/v3/projects/98128850352a420d9ba057aeae54e991` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:17.796015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98128850352a420d9ba057aeae54e991)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:17.797925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:17.843618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98128850352a420d9ba057aeae54e991', 'request_id': 'req-b7591111-8857-47f0-8e4b-01dfe7e9e139'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.849619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98128850352a420d9ba057aeae54e991', 'request_id': 'req-b7591111-8857-47f0-8e4b-01dfe7e9e139'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.856663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98128850352a420d9ba057aeae54e991', 'request_id': 'req-b7591111-8857-47f0-8e4b-01dfe7e9e139'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.867409 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] The token cache is being invalidate because project 98128850352a420d9ba057aeae54e991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:17.867694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.868310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b7591111-8857-47f0-8e4b-01dfe7e9e139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:17.869828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1234/2449] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:17 2022] DELETE /identity/v3/projects/98128850352a420d9ba057aeae54e991 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:17.874703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e57bf-7c64-4e48-bf57-d416b23f96ea None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:17.875002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e57bf-7c64-4e48-bf57-d416b23f96ea None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:17.875327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e57bf-7c64-4e48-bf57-d416b23f96ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:17.892667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-ae8e57bf-7c64-4e48-bf57-d416b23f96ea None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:17.894647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ae8e57bf-7c64-4e48-bf57-d416b23f96ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:17.952963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1216/2450] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:17.960896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe726de-6010-4fec-b730-1ebae690e945 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:17.961186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe726de-6010-4fec-b730-1ebae690e945 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:17.961486 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe726de-6010-4fec-b730-1ebae690e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:17.980046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-dbe726de-6010-4fec-b730-1ebae690e945 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:17.981238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-dbe726de-6010-4fec-b730-1ebae690e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:17.989052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1235/2451] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:17.993138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e57bf-7c64-4e48-bf57-d416b23f96ea None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.002781 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e57bf-7c64-4e48-bf57-d416b23f96ea None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.007352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.007998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.008284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.008584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.009307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:18.009615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.011216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.022930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1217/2452] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:18.027326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe726de-6010-4fec-b730-1ebae690e945 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.036974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe726de-6010-4fec-b730-1ebae690e945 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.041678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.042328 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.042615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.042898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.043636 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.045533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.069751 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1236/2453] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:18 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:18.073838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.083947 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd98933-086f-419f-9d07-3af1b183c609 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.087384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:18.141475 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.142076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.142364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.142645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.143896 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.145826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.165718 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1218/2454] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:18 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:18.169908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.180922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743c8d-01f8-45d8-b711-37c3470739c9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.185513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.186170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.186459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.186742 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.187500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.189089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.203018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1237/2455] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:18.204586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.215021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf33498-4577-4982-88d2-9da6d9c9464a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.219590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fde66-8191-4768-82c1-d5e57356ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.220245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fde66-8191-4768-82c1-d5e57356ced3 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.220529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fde66-8191-4768-82c1-d5e57356ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.220800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fde66-8191-4768-82c1-d5e57356ced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.221569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fde66-8191-4768-82c1-d5e57356ced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.223176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fde66-8191-4768-82c1-d5e57356ced3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.236581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1219/2456] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:18.237759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.247622 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54788cd1-8c82-4fce-a0a9-2ba367733e28 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.252293 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.253738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.254061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.254430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] PATH_INFO: `/v3/projects/e7ec87a0ffc24160afd550254647756e/users/466cab4ce9364cdd97d7b226a7c26716/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.272667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ec87a0ffc24160afd550254647756e, user_id=466cab4ce9364cdd97d7b226a7c26716, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.275706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.289279 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1238/2457] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:18 2022] PUT /identity/v3/projects/e7ec87a0ffc24160afd550254647756e/users/466cab4ce9364cdd97d7b226a7c26716/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:18.299524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09e4f3-1fca-42f9-a821-988ecc6a03bc None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.299830 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09e4f3-1fca-42f9-a821-988ecc6a03bc None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.300112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09e4f3-1fca-42f9-a821-988ecc6a03bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.327932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3c09e4f3-1fca-42f9-a821-988ecc6a03bc None None] MFA Rules not processed for user `466cab4ce9364cdd97d7b226a7c26716`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:18.329132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3c09e4f3-1fca-42f9-a821-988ecc6a03bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:18.401209 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1220/2458] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:18.412288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.413992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:18.448914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:18.494644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b7e6-529c-4b51-9037-0ff700685295 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.500268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5d829-bcba-4c54-bf28-5aa29072a073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.500921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5d829-bcba-4c54-bf28-5aa29072a073 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.501211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5d829-bcba-4c54-bf28-5aa29072a073 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.501496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5d829-bcba-4c54-bf28-5aa29072a073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.509639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5d829-bcba-4c54-bf28-5aa29072a073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.511234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5d829-bcba-4c54-bf28-5aa29072a073 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.520452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1239/2459] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:18.730149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09e4f3-1fca-42f9-a821-988ecc6a03bc None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.791124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09e4f3-1fca-42f9-a821-988ecc6a03bc None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:18.795571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:18.796457 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.796739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.797010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] PATH_INFO: `/v3/users/466cab4ce9364cdd97d7b226a7c26716` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.798218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466cab4ce9364cdd97d7b226a7c26716)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:18.800693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:18.816339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:18.846280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466cab4ce9364cdd97d7b226a7c26716'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:18.858031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466cab4ce9364cdd97d7b226a7c26716'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:18.865999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466cab4ce9364cdd97d7b226a7c26716'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:18.872875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466cab4ce9364cdd97d7b226a7c26716'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:18.873504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466cab4ce9364cdd97d7b226a7c26716'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:18.879941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1221/2460] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:18 2022] DELETE /identity/v3/users/466cab4ce9364cdd97d7b226a7c26716 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:18.884466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:18.884949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:18.885049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:18.902391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:18.903624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:18.964216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1240/2461] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:18.973692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:18.975086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:19.031604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91919a-a557-4227-8fe1-2398b8adc506 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.035292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51cc8d-0039-4322-a311-f252f61dd876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.035935 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51cc8d-0039-4322-a311-f252f61dd876 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.036225 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51cc8d-0039-4322-a311-f252f61dd876 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.036510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51cc8d-0039-4322-a311-f252f61dd876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.045367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51cc8d-0039-4322-a311-f252f61dd876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.046796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51cc8d-0039-4322-a311-f252f61dd876 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.056439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1222/2462] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:19.323710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.325138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:19.338189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8b4d-43f5-449b-b9f8-52d9efd27afa None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.343122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.344019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.344306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.344590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] PATH_INFO: `/v3/projects/e7ec87a0ffc24160afd550254647756e` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.347561 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ec87a0ffc24160afd550254647756e)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.349748 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.398303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ec87a0ffc24160afd550254647756e', 'request_id': 'req-38bc29cb-b71f-413f-97a7-08f10462df7a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:19.404182 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ec87a0ffc24160afd550254647756e', 'request_id': 'req-38bc29cb-b71f-413f-97a7-08f10462df7a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:19.412721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ec87a0ffc24160afd550254647756e', 'request_id': 'req-38bc29cb-b71f-413f-97a7-08f10462df7a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:19.424113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] The token cache is being invalidate because project e7ec87a0ffc24160afd550254647756e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:19.424417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:19.425088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-38bc29cb-b71f-413f-97a7-08f10462df7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:19.426853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1241/2463] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:19 2022] DELETE /identity/v3/projects/e7ec87a0ffc24160afd550254647756e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:19.431731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2d271-4b58-458e-afa4-9eec9c14b09d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.432230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2d271-4b58-458e-afa4-9eec9c14b09d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.432328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2d271-4b58-458e-afa4-9eec9c14b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.450905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e2b2d271-4b58-458e-afa4-9eec9c14b09d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:19.452452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e2b2d271-4b58-458e-afa4-9eec9c14b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:19.517077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1223/2464] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:19.526689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054ce6-17a5-4da7-9ea5-a4c0ff9bc8d8 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.526980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054ce6-17a5-4da7-9ea5-a4c0ff9bc8d8 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.527300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a054ce6-17a5-4da7-9ea5-a4c0ff9bc8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.545628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6a054ce6-17a5-4da7-9ea5-a4c0ff9bc8d8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:19.546823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6a054ce6-17a5-4da7-9ea5-a4c0ff9bc8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:19.554579 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1242/2465] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:19.558697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2d271-4b58-458e-afa4-9eec9c14b09d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.568203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2d271-4b58-458e-afa4-9eec9c14b09d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.572708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.573355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.573646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.573927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.574650 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:19.574962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.577469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.589241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1224/2466] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:19.593306 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a054ce6-17a5-4da7-9ea5-a4c0ff9bc8d8 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.602927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a054ce6-17a5-4da7-9ea5-a4c0ff9bc8d8 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.607530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.608172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.608457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.608735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.609415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.611325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.635286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1243/2467] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:19 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:19.639363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.650218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceb5e8-8cf2-4cb0-a4b2-dadfb33139b9 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.670987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:19.707753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.708409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.708694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.708973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.709648 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.711603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.730694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1225/2468] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:19 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:19.734861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.745011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505914-9c08-4440-ac5b-7c36ba9bdea0 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.749649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.750235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.750529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.750803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.751564 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.753640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.755121 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:19.767984 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1244/2469] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:19.769706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.779779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8966882-2f93-4b6a-bb5f-e1c1c102fc7b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.784456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd75d-3c65-4a17-a1b0-adaf2f63024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.785111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd75d-3c65-4a17-a1b0-adaf2f63024e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.785408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd75d-3c65-4a17-a1b0-adaf2f63024e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.785694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd75d-3c65-4a17-a1b0-adaf2f63024e admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.786419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd75d-3c65-4a17-a1b0-adaf2f63024e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.788067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd75d-3c65-4a17-a1b0-adaf2f63024e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.797725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1226/2470] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:19.801866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:19.811720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54ec9e-ab7d-44b1-b6da-aae17cc4dc00 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:19.816795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:19.817659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.817947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.818226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] PATH_INFO: `/v3/projects/73b0a58544f046809dbf8ba48b9d549f/users/bf25fd556c6541c4aa69cfaad0d4bbb3/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.832836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b0a58544f046809dbf8ba48b9d549f, user_id=bf25fd556c6541c4aa69cfaad0d4bbb3, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:19.835546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:19.848166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1245/2471] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:19 2022] PUT /identity/v3/projects/73b0a58544f046809dbf8ba48b9d549f/users/bf25fd556c6541c4aa69cfaad0d4bbb3/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:19.858153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b7d1c-9a50-4964-bc72-a655b379f78f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:19.858480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b7d1c-9a50-4964-bc72-a655b379f78f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:19.858766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b7d1c-9a50-4964-bc72-a655b379f78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:19.885373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-965b7d1c-9a50-4964-bc72-a655b379f78f None None] MFA Rules not processed for user `bf25fd556c6541c4aa69cfaad0d4bbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:19.886586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-965b7d1c-9a50-4964-bc72-a655b379f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:19.947788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1227/2472] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:19.952198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.012448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca2b2-9c4e-4544-88d3-3be67d2d1c29 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.016987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.017632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.017919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.018199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.019427 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.021320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.045985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1246/2473] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:19 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:20.050251 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b7d1c-9a50-4964-bc72-a655b379f78f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.061299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b7d1c-9a50-4964-bc72-a655b379f78f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.119120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.119825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.120107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.120383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.121095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.123007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.143517 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1228/2474] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:20 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:20.147544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.157897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b15d87-ef27-4bdb-82ea-19ac693d6615 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.162491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.163135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.163442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.163721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.164435 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.166058 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.176906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1247/2475] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:20.180893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.191151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902152d-070d-49c1-ba27-b67ae2d8c636 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.195715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.196588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.196874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.197154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] PATH_INFO: `/v3/projects/d6a0842d653d45b89c7aa3f45a8b871d/users/035a3ac4a8684d10b1eef9ebf33ec274/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.211368 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a0842d653d45b89c7aa3f45a8b871d, user_id=035a3ac4a8684d10b1eef9ebf33ec274, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.214021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.222063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:20.228127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1229/2476] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:20 2022] PUT /identity/v3/projects/d6a0842d653d45b89c7aa3f45a8b871d/users/035a3ac4a8684d10b1eef9ebf33ec274/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:20.231928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.242569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fab6a-c63f-44b3-8166-debd5f5e6331 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.296699 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75549c8d-c42d-4209-bba1-6e747d3f3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.297294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549c8d-c42d-4209-bba1-6e747d3f3b96 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.297583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549c8d-c42d-4209-bba1-6e747d3f3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.297867 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549c8d-c42d-4209-bba1-6e747d3f3b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.298581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75549c8d-c42d-4209-bba1-6e747d3f3b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.300736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75549c8d-c42d-4209-bba1-6e747d3f3b96 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.310956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1248/2477] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:20.315808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.325890 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b62587-58ec-4c72-a6ea-3e9ed02ff8fb admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.330598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.331590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.331877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.332155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] PATH_INFO: `/v3/projects/d6a0842d653d45b89c7aa3f45a8b871d/users/035a3ac4a8684d10b1eef9ebf33ec274/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.334094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a0842d653d45b89c7aa3f45a8b871d, user_id=035a3ac4a8684d10b1eef9ebf33ec274, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.336769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.346757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1230/2478] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:20 2022] PUT /identity/v3/projects/d6a0842d653d45b89c7aa3f45a8b871d/users/035a3ac4a8684d10b1eef9ebf33ec274/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:51:20.356462 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a5ea2-4ea8-4009-9d87-e4218b765416 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.356761 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a5ea2-4ea8-4009-9d87-e4218b765416 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.357048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a5ea2-4ea8-4009-9d87-e4218b765416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.384236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-5b0a5ea2-4ea8-4009-9d87-e4218b765416 None None] MFA Rules not processed for user `035a3ac4a8684d10b1eef9ebf33ec274`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:20.385444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5b0a5ea2-4ea8-4009-9d87-e4218b765416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:20.415021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:20.454463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1249/2479] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:20.466058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.467806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:20.525460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df33d2-cd6d-4ae1-bc0c-9b11ade57515 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.529100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.529740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.530025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.530303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.540365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.541785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.551875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1231/2480] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:51:20.623136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a5ea2-4ea8-4009-9d87-e4218b765416 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:20.632960 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a5ea2-4ea8-4009-9d87-e4218b765416 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:20.636769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:20.637406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:20.637692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:20.637971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:20.696556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:20.698018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:20.706904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1250/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:22.908123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:22.908691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:22.963967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffa4e-b05f-45c2-a924-00fdae53aed2 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:22.967519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54297e7-4d9f-4797-acfd-7aa1b83b13d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:22.968164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54297e7-4d9f-4797-acfd-7aa1b83b13d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:22.968452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54297e7-4d9f-4797-acfd-7aa1b83b13d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:22.968730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54297e7-4d9f-4797-acfd-7aa1b83b13d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:22.970479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b54297e7-4d9f-4797-acfd-7aa1b83b13d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:23.038498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54297e7-4d9f-4797-acfd-7aa1b83b13d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:23.039960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54297e7-4d9f-4797-acfd-7aa1b83b13d5 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:23.051352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1232/2482] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:23.384398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:23.447433 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5be4-bb6e-44e2-b232-d8c133e9da4c service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:23.451950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:23.452815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:23.453098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:23.453377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] PATH_INFO: `/v3/users/bf25fd556c6541c4aa69cfaad0d4bbb3` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:23.454540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf25fd556c6541c4aa69cfaad0d4bbb3)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:23.456814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:23.503727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf25fd556c6541c4aa69cfaad0d4bbb3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:23.515369 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf25fd556c6541c4aa69cfaad0d4bbb3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:23.516059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf25fd556c6541c4aa69cfaad0d4bbb3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:23.519129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:23.524873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf25fd556c6541c4aa69cfaad0d4bbb3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:23.534712 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf25fd556c6541c4aa69cfaad0d4bbb3'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:23.541370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1251/2483] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:23 2022] DELETE /identity/v3/users/bf25fd556c6541c4aa69cfaad0d4bbb3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:23.546181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:23.546478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:23.546819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:23.563260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:23.564456 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:23.589025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:23.624608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1233/2484] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:51:23.634364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:23.635883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:23.693050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c96b43-8691-4e6e-ad58-77b361f0be59 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:23.696616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:23.697252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:23.697539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:23.697819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:23.707490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:23.708944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:23.718207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1252/2485] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:23.986771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:23.988732 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.000524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501622b-5cd4-4b2a-b3c0-cab9ef76c308 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.006112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.006907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.007195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.007504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] PATH_INFO: `/v3/projects/73b0a58544f046809dbf8ba48b9d549f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.008690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b0a58544f046809dbf8ba48b9d549f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.010642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.056235 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b0a58544f046809dbf8ba48b9d549f', 'request_id': 'req-a992af70-7abd-4cf5-a31a-eea6fbf90fff'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.062312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b0a58544f046809dbf8ba48b9d549f', 'request_id': 'req-a992af70-7abd-4cf5-a31a-eea6fbf90fff'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.070185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b0a58544f046809dbf8ba48b9d549f', 'request_id': 'req-a992af70-7abd-4cf5-a31a-eea6fbf90fff'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.080571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] The token cache is being invalidate because project 73b0a58544f046809dbf8ba48b9d549f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:24.080860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.081483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.083016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1234/2486] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:23 2022] DELETE /identity/v3/projects/73b0a58544f046809dbf8ba48b9d549f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:24.086916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.096407 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55512f2-c634-460d-87cb-3da65eefad58 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.151483 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.152354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.152640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.152920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] PATH_INFO: `/v3/users/035a3ac4a8684d10b1eef9ebf33ec274` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.154091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035a3ac4a8684d10b1eef9ebf33ec274)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.156040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.204718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035a3ac4a8684d10b1eef9ebf33ec274'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.216639 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035a3ac4a8684d10b1eef9ebf33ec274'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.217411 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035a3ac4a8684d10b1eef9ebf33ec274'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.225507 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035a3ac4a8684d10b1eef9ebf33ec274'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.227527 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.228945 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.232936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035a3ac4a8684d10b1eef9ebf33ec274'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.239570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1253/2487] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:51:24 2022] DELETE /identity/v3/users/035a3ac4a8684d10b1eef9ebf33ec274 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:24.288190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992af70-7abd-4cf5-a31a-eea6fbf90fff admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.338993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d224a-6d40-42b3-9e67-d50a29a51d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.339767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d224a-6d40-42b3-9e67-d50a29a51d1f service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.340137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d224a-6d40-42b3-9e67-d50a29a51d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.340442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d224a-6d40-42b3-9e67-d50a29a51d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.342683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-881d224a-6d40-42b3-9e67-d50a29a51d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.365668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:24.421562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d224a-6d40-42b3-9e67-d50a29a51d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.423028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d224a-6d40-42b3-9e67-d50a29a51d1f service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.435114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1235/2488] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:51:24.527456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.528977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.540357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:24.603348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f9fe-5527-421b-b6df-ba452e072bd5 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.607971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.608856 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.609142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.609421 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] PATH_INFO: `/v3/projects/d6a0842d653d45b89c7aa3f45a8b871d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.610594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a0842d653d45b89c7aa3f45a8b871d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.613120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.658162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a0842d653d45b89c7aa3f45a8b871d', 'request_id': 'req-3df8a300-d18c-4161-93fd-d8cd1f6e6290'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.663654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a0842d653d45b89c7aa3f45a8b871d', 'request_id': 'req-3df8a300-d18c-4161-93fd-d8cd1f6e6290'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.670881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a0842d653d45b89c7aa3f45a8b871d', 'request_id': 'req-3df8a300-d18c-4161-93fd-d8cd1f6e6290'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.682192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] The token cache is being invalidate because project d6a0842d653d45b89c7aa3f45a8b871d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:51:24.682481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.683103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-3df8a300-d18c-4161-93fd-d8cd1f6e6290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:51:24.684675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1254/2489] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:51:24 2022] DELETE /identity/v3/projects/d6a0842d653d45b89c7aa3f45a8b871d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:51:24.691731 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd75ed-36b0-4e89-b0c8-922013a5a6e0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.692023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd75ed-36b0-4e89-b0c8-922013a5a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.692331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd75ed-36b0-4e89-b0c8-922013a5a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.709499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d0cd75ed-36b0-4e89-b0c8-922013a5a6e0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:24.710813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d0cd75ed-36b0-4e89-b0c8-922013a5a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.774707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1236/2490] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:24.783835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8823dd-bbff-433b-954e-bbcc4e5882fc None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.784157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8823dd-bbff-433b-954e-bbcc4e5882fc None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.784444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8823dd-bbff-433b-954e-bbcc4e5882fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.802672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9c8823dd-bbff-433b-954e-bbcc4e5882fc None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:24.803904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9c8823dd-bbff-433b-954e-bbcc4e5882fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:24.811752 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1255/2491] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:24.816573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd75ed-36b0-4e89-b0c8-922013a5a6e0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.826404 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd75ed-36b0-4e89-b0c8-922013a5a6e0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.830953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.831644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.831928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.832207 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.832936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:51:24.833353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.834957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.846283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1237/2492] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:51:24.850577 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8823dd-bbff-433b-954e-bbcc4e5882fc None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.859858 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8823dd-bbff-433b-954e-bbcc4e5882fc None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.865060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.865713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.866001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.866282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.866971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.868919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.894498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1256/2493] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:51:24 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:24.898854 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:24.908757 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67383f1c-58d3-4749-a30c-664c1fb901f6 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:24.963751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:24.964407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:24.964693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:24.964973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:24.965645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:24.967582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:24.987846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1238/2494] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:51:24 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:51:24.991871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.001981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731fed-e055-4560-a6ea-7178d6323501 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.007059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.007749 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.008037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.008319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.009037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.010628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.021343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1257/2495] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:51:25.025516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.035229 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d4c4-66e6-4b69-8570-6f4da958ba97 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.039805 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e134de-5d2d-4944-8706-e026be29ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.040461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e134de-5d2d-4944-8706-e026be29ae08 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.040753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e134de-5d2d-4944-8706-e026be29ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.041036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e134de-5d2d-4944-8706-e026be29ae08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.041767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e134de-5d2d-4944-8706-e026be29ae08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.043389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e134de-5d2d-4944-8706-e026be29ae08 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.053777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1239/2496] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:51:25.057614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.068114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d623-0eb8-43c1-865c-65834de38df4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.072720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.073587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.073876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.074155 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] PATH_INFO: `/v3/projects/ef682ab4e1004157904d206a75da0ee0/users/fa1fe2232ee44c2d834941120c042d17/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.088904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef682ab4e1004157904d206a75da0ee0, user_id=fa1fe2232ee44c2d834941120c042d17, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.091565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.105167 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1258/2497] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:51:25 2022] PUT /identity/v3/projects/ef682ab4e1004157904d206a75da0ee0/users/fa1fe2232ee44c2d834941120c042d17/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:51:25.110126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e60df-b51c-41ed-92ec-2d70713f5d83 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.110423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e60df-b51c-41ed-92ec-2d70713f5d83 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.110709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e60df-b51c-41ed-92ec-2d70713f5d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.128067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-395e60df-b51c-41ed-92ec-2d70713f5d83 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:25.129266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-395e60df-b51c-41ed-92ec-2d70713f5d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:25.138254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:25.199674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1240/2498] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:25.209950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:25.212368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:25.247242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:25.271165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736140d5-ed91-4b7f-a108-d4306b31d498 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:25.275138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:25.275873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.276129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.276414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.285693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:25.287109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:25.296350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1259/2499] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:25.905375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5a4fc-1221-44a3-b87f-e4100bcbf97b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:25.905673 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5a4fc-1221-44a3-b87f-e4100bcbf97b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:25.905985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5a4fc-1221-44a3-b87f-e4100bcbf97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:25.933366 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e2b5a4fc-1221-44a3-b87f-e4100bcbf97b None None] MFA Rules not processed for user `fa1fe2232ee44c2d834941120c042d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:25.934605 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e2b5a4fc-1221-44a3-b87f-e4100bcbf97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:26.002196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1241/2500] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:26.013297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:26.014689 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:26.073703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f7f6-6a16-4365-9803-8628736f136b service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:26.077246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:26.077888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:26.078173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:26.078448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:26.087408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:26.088813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:26.098263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1260/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:27.447079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456cce-e063-4f2a-a29b-31746577b1ef None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:27.447568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456cce-e063-4f2a-a29b-31746577b1ef None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:27.447821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456cce-e063-4f2a-a29b-31746577b1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:27.465345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0f456cce-e063-4f2a-a29b-31746577b1ef None None] MFA Rules not processed for user `fa1fe2232ee44c2d834941120c042d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:27.466584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0f456cce-e063-4f2a-a29b-31746577b1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:27.474183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1242/2502] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:36.093454 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=37 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:36.235286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:36.236650 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:36.307312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d462-2cff-4a06-a184-7682242e62bd service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:36.313054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:36.313696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:36.313982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:36.314264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:36.316034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:36.372337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:36.373932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:36.383776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1261/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:37.459851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=55 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:38.076241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0990d-4ab7-4db2-8ea2-e4055a257392 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:38.076614 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0990d-4ab7-4db2-8ea2-e4055a257392 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:38.076894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0990d-4ab7-4db2-8ea2-e4055a257392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:38.123588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-51d0990d-4ab7-4db2-8ea2-e4055a257392 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:38.124793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-51d0990d-4ab7-4db2-8ea2-e4055a257392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:38.187876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1243/2504] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:51:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:38.233461 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:38.234902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:38.329243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a5597-a76e-49c8-9af3-7917d2a13453 service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:38.334353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:38.335002 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:38.335326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:38.335610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:38.343842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:38.345418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:38.353932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1262/2505] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:51:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:51:42.707886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:42.708399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:42.708493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:42.730309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] MFA Rules not processed for user `fa1fe2232ee44c2d834941120c042d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:42.731808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:42.748036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1244/2506] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:51:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:43.009880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:43.011426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:43.024529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c02af-01b3-4873-a265-00d18775e8c6 service swift] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:43.028136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:43.028787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:43.029077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:43.029337 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:43.031176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:43.038212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:43.043694 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:43.045137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:43.054387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1263/2507] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:43.435008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:43.435008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:43.531063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64035b7-bf6c-4106-90e5-ff793d155794 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:43.536342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea7ba-78ac-4fad-a75a-0f429dfa5699 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:43.537203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea7ba-78ac-4fad-a75a-0f429dfa5699 service placement] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:43.538139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea7ba-78ac-4fad-a75a-0f429dfa5699 service placement] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:43.538430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea7ba-78ac-4fad-a75a-0f429dfa5699 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:43.540491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9eaea7ba-78ac-4fad-a75a-0f429dfa5699 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:43.553148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea7ba-78ac-4fad-a75a-0f429dfa5699 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:43.554811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea7ba-78ac-4fad-a75a-0f429dfa5699 service placement] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:43.575274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1245/2508] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:45.316488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:45.343948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4466c-c97d-411a-913c-b172773d87a6 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:45.356476 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36a137-2cc4-4c55-95ff-faca27fe4753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:45.357149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36a137-2cc4-4c55-95ff-faca27fe4753 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:45.357445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36a137-2cc4-4c55-95ff-faca27fe4753 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:45.357848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36a137-2cc4-4c55-95ff-faca27fe4753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:45.363826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cc36a137-2cc4-4c55-95ff-faca27fe4753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:45.466076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36a137-2cc4-4c55-95ff-faca27fe4753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:45.468447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36a137-2cc4-4c55-95ff-faca27fe4753 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:45.480594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1264/2509] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:53.101631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749f08-1066-409a-a16c-1e5c9d37a871 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.102392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749f08-1066-409a-a16c-1e5c9d37a871 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.102765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749f08-1066-409a-a16c-1e5c9d37a871 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.104276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1246/2510] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:51:53.109951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba57ab-56f1-4e3e-8e83-a9cedc9a3802 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.110391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba57ab-56f1-4e3e-8e83-a9cedc9a3802 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.110592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba57ab-56f1-4e3e-8e83-a9cedc9a3802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.148428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-ddba57ab-56f1-4e3e-8e83-a9cedc9a3802 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:53.149891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ddba57ab-56f1-4e3e-8e83-a9cedc9a3802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:53.159076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1265/2511] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:51:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:53.170122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12749f08-1066-409a-a16c-1e5c9d37a871 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:53.171836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-12749f08-1066-409a-a16c-1e5c9d37a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:53.231936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:51:53.253780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12749f08-1066-409a-a16c-1e5c9d37a871 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:53.258612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0247ef-8463-4858-a35f-a65a67979cf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:53.259274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0247ef-8463-4858-a35f-a65a67979cf3 service glance] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.259586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0247ef-8463-4858-a35f-a65a67979cf3 service glance] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.259861 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0247ef-8463-4858-a35f-a65a67979cf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.269699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0247ef-8463-4858-a35f-a65a67979cf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:53.271117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0247ef-8463-4858-a35f-a65a67979cf3 service glance] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:53.281726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1247/2512] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:53.346782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee5e5-5647-47ef-93ae-8d6c65bb885e None None] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.347080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee5e5-5647-47ef-93ae-8d6c65bb885e None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.347422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee5e5-5647-47ef-93ae-8d6c65bb885e None None] PATH_INFO: `/` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.348803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1266/2513] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:51:53.353954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff827-09a3-4e8b-be1f-27ebded8c329 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.354270 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff827-09a3-4e8b-be1f-27ebded8c329 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.354610 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff827-09a3-4e8b-be1f-27ebded8c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.373091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-a24ff827-09a3-4e8b-be1f-27ebded8c329 None None] MFA Rules not processed for user `45c718c1e1024d73b6b635f77bacdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:53.374306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a24ff827-09a3-4e8b-be1f-27ebded8c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:53.380937 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1248/2514] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:51:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:53.392185 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ee5e5-5647-47ef-93ae-8d6c65bb885e None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:53.403332 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ee5e5-5647-47ef-93ae-8d6c65bb885e None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:53.406790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc482a4-efe7-4493-901c-98a57c627e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:53.407465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc482a4-efe7-4493-901c-98a57c627e70 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.407747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc482a4-efe7-4493-901c-98a57c627e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.408021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc482a4-efe7-4493-901c-98a57c627e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.415584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc482a4-efe7-4493-901c-98a57c627e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:53.416976 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc482a4-efe7-4493-901c-98a57c627e70 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:53.424601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1267/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:53.506411 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00eb19-82ab-4f04-8e5d-064e45bc1413 None None] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.506668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00eb19-82ab-4f04-8e5d-064e45bc1413 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.506952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00eb19-82ab-4f04-8e5d-064e45bc1413 None None] PATH_INFO: `/` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.508391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1249/2516] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 23 13:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:51:53.513780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa61-3403-4688-bfde-f2d157671740 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.514071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa61-3403-4688-bfde-f2d157671740 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.514353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574faa61-3403-4688-bfde-f2d157671740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.532404 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-574faa61-3403-4688-bfde-f2d157671740 None None] MFA Rules not processed for user `c37e7d70e2864edaa125e8f5ac1a3373`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:53.533575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-574faa61-3403-4688-bfde-f2d157671740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:53.543578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1268/2517] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 23 13:51:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:53.554380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00eb19-82ab-4f04-8e5d-064e45bc1413 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:53.565345 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00eb19-82ab-4f04-8e5d-064e45bc1413 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:53.569055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9c5f2-384b-4d3a-8ed7-f54ca00d3b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:53.569696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9c5f2-384b-4d3a-8ed7-f54ca00d3b00 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:53.569985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9c5f2-384b-4d3a-8ed7-f54ca00d3b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:53.570268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9c5f2-384b-4d3a-8ed7-f54ca00d3b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:53.580503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9c5f2-384b-4d3a-8ed7-f54ca00d3b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:53.581941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9c5f2-384b-4d3a-8ed7-f54ca00d3b00 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:53.592528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1250/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:54.994620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574faa61-3403-4688-bfde-f2d157671740 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:55.004628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574faa61-3403-4688-bfde-f2d157671740 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:55.009169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:55.010050 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:55.010340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:55.010656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:55.012481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:55.025401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:55.027068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:55.036515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1269/2519] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:51:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:51:57.252050 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2182c9-f549-4992-b834-bd3543884832 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:57.252607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2182c9-f549-4992-b834-bd3543884832 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:57.252607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2182c9-f549-4992-b834-bd3543884832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:57.270838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-eb2182c9-f549-4992-b834-bd3543884832 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:51:57.272691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-eb2182c9-f549-4992-b834-bd3543884832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:51:57.280199 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1251/2520] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:51:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:51:57.292183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:51:57.304189 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0890-3622-4c5f-95a7-010caac99f11 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:51:57.309335 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:51:57.309981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:51:57.310270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:51:57.310551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:51:57.320821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:51:57.322702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:51:57.331175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1270/2521] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:51:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:52:00.864838 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2182c9-f549-4992-b834-bd3543884832 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:00.875113 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2182c9-f549-4992-b834-bd3543884832 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:00.878778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:00.879470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:00.879756 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:00.880035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:00.882444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:00.894693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:00.896165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:00.906563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1252/2522] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:52:05.356466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:05.357846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:05.372928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca16b28-5f80-448a-8540-160393dcbe2a service swift] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:05.377626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:05.378595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:05.379016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:05.379474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] PATH_INFO: `/v3/users/c468cd8df1564441935e4edfba55ccc8` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:05.380866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c468cd8df1564441935e4edfba55ccc8)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:05.383036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:05.439840 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c468cd8df1564441935e4edfba55ccc8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.451562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c468cd8df1564441935e4edfba55ccc8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.452228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c468cd8df1564441935e4edfba55ccc8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.459710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c468cd8df1564441935e4edfba55ccc8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.466644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-089e7a9e-a96a-4af3-a89e-a8d7143a17f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c468cd8df1564441935e4edfba55ccc8'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.468203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:05.473860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1271/2523] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:05 2022] DELETE /identity/v3/users/c468cd8df1564441935e4edfba55ccc8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:05.774625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:05.793814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a706-551c-4356-9360-15ddd0dc9ddc service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:05.856188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:05.857069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:05.857362 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:05.857647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] PATH_INFO: `/v3/projects/d54111715ea041d0b876d1ad66a14e31` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:05.858840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54111715ea041d0b876d1ad66a14e31)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:05.860793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:05.924567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54111715ea041d0b876d1ad66a14e31', 'request_id': 'req-fbc359ad-ed8b-4787-8742-9b9a333870be'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.930873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54111715ea041d0b876d1ad66a14e31', 'request_id': 'req-fbc359ad-ed8b-4787-8742-9b9a333870be'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.938234 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54111715ea041d0b876d1ad66a14e31', 'request_id': 'req-fbc359ad-ed8b-4787-8742-9b9a333870be'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.949729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] The token cache is being invalidate because project d54111715ea041d0b876d1ad66a14e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:05.950016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.950631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-fbc359ad-ed8b-4787-8742-9b9a333870be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:05.952196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1253/2524] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:05 2022] DELETE /identity/v3/projects/d54111715ea041d0b876d1ad66a14e31 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:05.957067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b785d0-774d-4e5e-9cf6-c74c6540c272 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:05.957361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b785d0-774d-4e5e-9cf6-c74c6540c272 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:05.957644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b785d0-774d-4e5e-9cf6-c74c6540c272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:05.976668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b6b785d0-774d-4e5e-9cf6-c74c6540c272 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:05.977873 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b6b785d0-774d-4e5e-9cf6-c74c6540c272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:06.048906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1272/2525] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:06.057216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d6ff8-5b68-42a4-b6ae-b5bc9f290148 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.057513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d6ff8-5b68-42a4-b6ae-b5bc9f290148 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.057794 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d6ff8-5b68-42a4-b6ae-b5bc9f290148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.076952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-605d6ff8-5b68-42a4-b6ae-b5bc9f290148 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:06.078156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-605d6ff8-5b68-42a4-b6ae-b5bc9f290148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:06.086639 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1254/2526] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:06.090670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b785d0-774d-4e5e-9cf6-c74c6540c272 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:06.110853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b785d0-774d-4e5e-9cf6-c74c6540c272 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:06.116732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:06.117670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.118388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.119054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.120160 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:06.120686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:06.122500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:06.139851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1273/2527] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:52:06.144283 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d6ff8-5b68-42a4-b6ae-b5bc9f290148 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:06.154759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d6ff8-5b68-42a4-b6ae-b5bc9f290148 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:06.160427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:06.161094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.161381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.161661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.162393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:06.164388 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:06.185674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:06.195768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1255/2528] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:06 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:06.199817 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:06.216794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ea8f-cd80-40a8-9139-1cf027fee50d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:06.300724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:06.301737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.302361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.302677 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.303417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:06.305553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:06.328762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1274/2529] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:06 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:06.332790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:06.343631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086da92-6760-4070-be64-56a209c810ea admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:06.348263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:06.348924 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.349213 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.349525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.350253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:06.351919 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:06.365375 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1256/2530] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:06.366838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:06.376896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541932-4d2e-4ead-ad52-6221f0a8c729 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:06.382259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a257d-2394-4af2-9dda-29e30f8006ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:06.382914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a257d-2394-4af2-9dda-29e30f8006ec admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.383331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a257d-2394-4af2-9dda-29e30f8006ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.383501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a257d-2394-4af2-9dda-29e30f8006ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.384241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a257d-2394-4af2-9dda-29e30f8006ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:06.385861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a257d-2394-4af2-9dda-29e30f8006ec admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:06.399383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1275/2531] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:06.403032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:06.413279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3a8e-d378-4d11-8675-f14fcba2bbd2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:06.418188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:06.419069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.419392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.419676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] PATH_INFO: `/v3/projects/697bd8ff54fe4909b8fd4d06a483a652/users/9c71808d98e94252914a36f8db07ddbf/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.439668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697bd8ff54fe4909b8fd4d06a483a652, user_id=9c71808d98e94252914a36f8db07ddbf, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:06.442233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:06.455546 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1257/2532] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:06 2022] PUT /identity/v3/projects/697bd8ff54fe4909b8fd4d06a483a652/users/9c71808d98e94252914a36f8db07ddbf/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:06.466190 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.466488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.466769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.493115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] MFA Rules not processed for user `9c71808d98e94252914a36f8db07ddbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:06.494305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:06.547218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:06.558438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1276/2533] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:06.569441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:06.571103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:06.642627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c005f7-f01e-49aa-a9e9-3a1b6d41a3c1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:06.648245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:06.649146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:06.649439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:06.649723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:06.657438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:06.659028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:06.667784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1258/2534] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:08.146296 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:08.147995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:08.168920 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18021a7c-b2ef-42a3-bcd4-0dcaf0aaa258 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:08.174395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507bd98-6881-4893-8ac5-8f0832fc961f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:08.175126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bd98-6881-4893-8ac5-8f0832fc961f service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:08.175464 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bd98-6881-4893-8ac5-8f0832fc961f service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:08.175745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bd98-6881-4893-8ac5-8f0832fc961f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:08.178023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7507bd98-6881-4893-8ac5-8f0832fc961f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:08.190473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507bd98-6881-4893-8ac5-8f0832fc961f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:08.192148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507bd98-6881-4893-8ac5-8f0832fc961f service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:08.215226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1277/2535] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:09.447284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:09.512977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851fee-1ad4-41cb-82d8-c4ac9c07cde5 service nova] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:09.517601 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:09.518504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:09.518789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:09.519068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] PATH_INFO: `/v3/users/9c71808d98e94252914a36f8db07ddbf` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:09.520405 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c71808d98e94252914a36f8db07ddbf)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:09.522329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:09.571943 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c71808d98e94252914a36f8db07ddbf'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:09.577367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:09.586424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c71808d98e94252914a36f8db07ddbf'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:09.600136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c71808d98e94252914a36f8db07ddbf'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:09.610754 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c71808d98e94252914a36f8db07ddbf'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:09.614428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c71808d98e94252914a36f8db07ddbf'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:09.626670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1259/2536] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:09 2022] DELETE /identity/v3/users/9c71808d98e94252914a36f8db07ddbf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:09.632796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:09.633283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:09.633375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:09.653420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:09.654860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:09.730593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1278/2537] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:52:09.741157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:09.742857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:09.827332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca84b9-8e01-4d5a-9ecf-9f756f37aef9 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:09.832055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce6d73-ed1c-406a-a117-f7c194e52f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:09.833176 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce6d73-ed1c-406a-a117-f7c194e52f64 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:09.833467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce6d73-ed1c-406a-a117-f7c194e52f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:09.833747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce6d73-ed1c-406a-a117-f7c194e52f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:09.844484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce6d73-ed1c-406a-a117-f7c194e52f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:09.847307 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce6d73-ed1c-406a-a117-f7c194e52f64 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:09.859612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1260/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:10.187056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.188572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:10.204111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a2aa-fdf8-4f4c-b87d-2eb979ff4315 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.208657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.210170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.210765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.210765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] PATH_INFO: `/v3/projects/697bd8ff54fe4909b8fd4d06a483a652` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.211934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=697bd8ff54fe4909b8fd4d06a483a652)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.214320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.273721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697bd8ff54fe4909b8fd4d06a483a652', 'request_id': 'req-cea068e5-25ee-4571-972a-666de4682cbb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:10.281339 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697bd8ff54fe4909b8fd4d06a483a652', 'request_id': 'req-cea068e5-25ee-4571-972a-666de4682cbb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:10.289202 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697bd8ff54fe4909b8fd4d06a483a652', 'request_id': 'req-cea068e5-25ee-4571-972a-666de4682cbb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:10.302581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] The token cache is being invalidate because project 697bd8ff54fe4909b8fd4d06a483a652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:10.303321 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:10.304003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cea068e5-25ee-4571-972a-666de4682cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:10.305645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1279/2539] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:10 2022] DELETE /identity/v3/projects/697bd8ff54fe4909b8fd4d06a483a652 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:10.310544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22156820-c299-45ac-af26-d6199c59edfd None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.310858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22156820-c299-45ac-af26-d6199c59edfd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.311138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22156820-c299-45ac-af26-d6199c59edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.329364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-22156820-c299-45ac-af26-d6199c59edfd None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:10.330293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-22156820-c299-45ac-af26-d6199c59edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:10.388378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1261/2540] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:10.396891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07cf0b-cb10-4a58-8faa-d03f7b36260b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.396891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07cf0b-cb10-4a58-8faa-d03f7b36260b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.397187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07cf0b-cb10-4a58-8faa-d03f7b36260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.415958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-bb07cf0b-cb10-4a58-8faa-d03f7b36260b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:10.417145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bb07cf0b-cb10-4a58-8faa-d03f7b36260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:10.424968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1280/2541] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:10.429247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22156820-c299-45ac-af26-d6199c59edfd None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.439357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22156820-c299-45ac-af26-d6199c59edfd None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.443922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.444586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.444878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.445166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.445951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:10.446265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.447923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.460391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1262/2542] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:52:10.464703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07cf0b-cb10-4a58-8faa-d03f7b36260b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.474275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07cf0b-cb10-4a58-8faa-d03f7b36260b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.480081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.481316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.481316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.481316 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.482007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.483953 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.511097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1281/2543] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:10 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:10.515013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.525870 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0e52e-df31-4836-a590-677f6bb90837 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.590080 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.590750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.591036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.591353 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.592029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.593942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.600851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:10.616277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1263/2544] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:10 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:10.620390 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.630358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c2a51-7ce4-4eac-89ec-7e891f744694 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.634850 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.635537 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.635821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.636238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.636958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.638533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.648996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1282/2545] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:10.652811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.663347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5c4b-82db-4324-a2d8-406cf6778b7c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.667926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb3968-a166-44d8-a926-7353ffa297fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.668580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb3968-a166-44d8-a926-7353ffa297fc admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.668865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb3968-a166-44d8-a926-7353ffa297fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.669140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb3968-a166-44d8-a926-7353ffa297fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.669860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb3968-a166-44d8-a926-7353ffa297fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.671482 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb3968-a166-44d8-a926-7353ffa297fc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.682562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1264/2546] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:10.686425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.696515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39778105-ee33-4bd5-a010-44a35004b3a3 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.701115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.702069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.702274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.702557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] PATH_INFO: `/v3/projects/a0e447c57a0b46d5a985d130ce7e45df/users/b58453a69bac45f186260c2b2238fb77/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.718899 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e447c57a0b46d5a985d130ce7e45df, user_id=b58453a69bac45f186260c2b2238fb77, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.721872 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.731516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:10.736797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1283/2547] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:10 2022] PUT /identity/v3/projects/a0e447c57a0b46d5a985d130ce7e45df/users/b58453a69bac45f186260c2b2238fb77/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:10.749055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e646660-050b-4781-8f29-4d40b5d12b1d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.749471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e646660-050b-4781-8f29-4d40b5d12b1d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.749776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e646660-050b-4781-8f29-4d40b5d12b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.778498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-9e646660-050b-4781-8f29-4d40b5d12b1d None None] MFA Rules not processed for user `b58453a69bac45f186260c2b2238fb77`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:10.779800 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9e646660-050b-4781-8f29-4d40b5d12b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:10.846163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1265/2548] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:10.851372 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.915197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fd3c0-81eb-41ba-8766-97a8141080cc admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:10.919947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:10.920582 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:10.920874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:10.921152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:10.921845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:10.923785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:10.950495 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1284/2549] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:10 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:10.954681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e646660-050b-4781-8f29-4d40b5d12b1d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:10.965973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e646660-050b-4781-8f29-4d40b5d12b1d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:11.033317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:11.034112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.034469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.034820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.035627 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:11.037677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:11.063224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1266/2550] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:10 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:11.069234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:11.080681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedf53d-1986-4521-bcc0-6f32c6664d0b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:11.085835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:11.087080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.087927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.087927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.088408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:11.090027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:11.105449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1285/2551] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:11.105980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:11.117015 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209c54c-3bac-4ebb-8477-89c735306ed6 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:11.122683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:11.123069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.123358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.124009 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] PATH_INFO: `/v3/projects/0490ee8cdce3475bae66d5f1446d0cb8/users/7a906a36bf5c453e909f5e4488de503c/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.141094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0490ee8cdce3475bae66d5f1446d0cb8, user_id=7a906a36bf5c453e909f5e4488de503c, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:11.143796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:11.186701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1267/2552] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:11 2022] PUT /identity/v3/projects/0490ee8cdce3475bae66d5f1446d0cb8/users/7a906a36bf5c453e909f5e4488de503c/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:11.186940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:11.197324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31d07a-02bd-4a72-9140-770bd0fb1b4b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:11.269420 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fbd8d-f544-4f4f-b7f1-06a3bba99c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:11.270169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbd8d-f544-4f4f-b7f1-06a3bba99c0c admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.270455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbd8d-f544-4f4f-b7f1-06a3bba99c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.270785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbd8d-f544-4f4f-b7f1-06a3bba99c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.272091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fbd8d-f544-4f4f-b7f1-06a3bba99c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:11.273756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fbd8d-f544-4f4f-b7f1-06a3bba99c0c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:11.288272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1286/2553] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:52:11.304817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:11.364416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87b626-1881-4d9c-a464-c7051e59fbb5 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:11.369372 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:11.370609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.370609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.370850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] PATH_INFO: `/v3/projects/0490ee8cdce3475bae66d5f1446d0cb8/users/7a906a36bf5c453e909f5e4488de503c/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.373843 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0490ee8cdce3475bae66d5f1446d0cb8, user_id=7a906a36bf5c453e909f5e4488de503c, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:11.375636 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:11.413284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1268/2554] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:11 2022] PUT /identity/v3/projects/0490ee8cdce3475bae66d5f1446d0cb8/users/7a906a36bf5c453e909f5e4488de503c/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:11.428832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c62d-3735-4147-88ac-326edf00bbd8 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.429642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c62d-3735-4147-88ac-326edf00bbd8 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.429642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c62d-3735-4147-88ac-326edf00bbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.499006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-7407c62d-3735-4147-88ac-326edf00bbd8 None None] MFA Rules not processed for user `7a906a36bf5c453e909f5e4488de503c`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:11.500802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7407c62d-3735-4147-88ac-326edf00bbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:11.612664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:11.630314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1287/2555] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:11.641523 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:11.643576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:11.670746 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:11.721994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc564ea-df07-4a02-bdea-d1944cc6a70d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:11.728425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:11.729093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.729991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.729991 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.739837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:11.741323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:11.753135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1269/2556] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:11.843142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407c62d-3735-4147-88ac-326edf00bbd8 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:11.856661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407c62d-3735-4147-88ac-326edf00bbd8 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:11.861900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c372c-a6df-4073-a82e-40f4da0a6744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:11.862951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c372c-a6df-4073-a82e-40f4da0a6744 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:11.863365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c372c-a6df-4073-a82e-40f4da0a6744 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:11.863730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c372c-a6df-4073-a82e-40f4da0a6744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:11.933001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c372c-a6df-4073-a82e-40f4da0a6744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:11.934510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c372c-a6df-4073-a82e-40f4da0a6744 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:11.944998 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1288/2557] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:11.945150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:11.946620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:12.056671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a17384-cb0a-4695-a285-f65440ae4fd4 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:12.063418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:12.064092 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:12.064530 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:12.065347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:12.067834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:12.082702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:12.085057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:12.101729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1270/2558] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:12.356908 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde0c6-47f0-4c35-8df5-71b04429d021 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:12.357248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde0c6-47f0-4c35-8df5-71b04429d021 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:12.357543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde0c6-47f0-4c35-8df5-71b04429d021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:12.377515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-85cde0c6-47f0-4c35-8df5-71b04429d021 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:12.378876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-85cde0c6-47f0-4c35-8df5-71b04429d021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:12.440148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1289/2559] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:52:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:12.452300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:12.453690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:12.522792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaa08a-72d2-4fc0-bdd7-9d20c55ddf3f service nova] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:12.528120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:12.528796 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:12.529085 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:12.529370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:12.537922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:12.539547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:12.547466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1271/2560] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:52:13.573815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d119031-b315-4c23-91c1-974a823fdb06 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:13.574760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d119031-b315-4c23-91c1-974a823fdb06 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:13.575576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d119031-b315-4c23-91c1-974a823fdb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:13.617370 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-5d119031-b315-4c23-91c1-974a823fdb06 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:13.619245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5d119031-b315-4c23-91c1-974a823fdb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:13.635954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1290/2561] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 23 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:13.658313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:13.674127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f537-f461-4209-97b9-8b9396dd5fa3 service swift] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:13.687035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23bb0a-234f-4c5f-9990-ecc4b1f22816 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:13.687764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bb0a-234f-4c5f-9990-ecc4b1f22816 service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:13.688051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bb0a-234f-4c5f-9990-ecc4b1f22816 service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:13.688336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bb0a-234f-4c5f-9990-ecc4b1f22816 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:13.700777 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23bb0a-234f-4c5f-9990-ecc4b1f22816 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:13.702624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23bb0a-234f-4c5f-9990-ecc4b1f22816 service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:13.712244 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1272/2562] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:52:19.196220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d119031-b315-4c23-91c1-974a823fdb06 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:19.278487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d119031-b315-4c23-91c1-974a823fdb06 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:19.283456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:19.284297 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:19.284594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:19.284900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] PATH_INFO: `/v3/users/b58453a69bac45f186260c2b2238fb77` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:19.286161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58453a69bac45f186260c2b2238fb77)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:19.288443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:19.336556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:19.348811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58453a69bac45f186260c2b2238fb77'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:19.361859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58453a69bac45f186260c2b2238fb77'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:19.362729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58453a69bac45f186260c2b2238fb77'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:19.372041 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58453a69bac45f186260c2b2238fb77'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:19.380284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58453a69bac45f186260c2b2238fb77'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:19.390970 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1291/2563] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:19 2022] DELETE /identity/v3/users/b58453a69bac45f186260c2b2238fb77 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:19.392968 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:19.393503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:19.393503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:19.411563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:19.412806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:19.434504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:19.499069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1273/2564] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:52:19.506460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:19.508064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:19.587092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791be2-f463-48a0-97df-c4a921e6e6b9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:19.593211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:19.593884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:19.594183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:19.594475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:19.608544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:19.610006 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:19.622848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1292/2565] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:19.940024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:19.942277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:19.972720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac18f-09c4-4474-ad03-a7c9efc1a874 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:19.979392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:19.980534 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:19.981264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:19.981712 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] PATH_INFO: `/v3/projects/a0e447c57a0b46d5a985d130ce7e45df` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:19.983448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e447c57a0b46d5a985d130ce7e45df)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:19.985704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:20.050130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e447c57a0b46d5a985d130ce7e45df', 'request_id': 'req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.060296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e447c57a0b46d5a985d130ce7e45df', 'request_id': 'req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.072117 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e447c57a0b46d5a985d130ce7e45df', 'request_id': 'req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.085425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] The token cache is being invalidate because project a0e447c57a0b46d5a985d130ce7e45df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:20.085860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.086576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.089007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1274/2566] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:19 2022] DELETE /identity/v3/projects/a0e447c57a0b46d5a985d130ce7e45df => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:20.093734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:20.106059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72628349-fab5-4e36-a61a-eaa879a35a16 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:20.218688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:20.219765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:20.220062 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:20.220343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] PATH_INFO: `/v3/users/7a906a36bf5c453e909f5e4488de503c` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:20.221575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a906a36bf5c453e909f5e4488de503c)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:20.223566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:20.282488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a906a36bf5c453e909f5e4488de503c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.295638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:20.302104 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a906a36bf5c453e909f5e4488de503c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.303227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a906a36bf5c453e909f5e4488de503c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.314526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a906a36bf5c453e909f5e4488de503c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.337954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-bd383b8c-cd14-44a5-8ce4-ecc134cd5558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a906a36bf5c453e909f5e4488de503c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.350100 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1293/2567] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:20 2022] DELETE /identity/v3/users/7a906a36bf5c453e909f5e4488de503c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:20.738408 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:20.740430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:20.754466 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e7bb0-a23b-4ccb-9539-abd7877966fc admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:20.827513 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:20.828301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:20.828590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:20.828867 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] PATH_INFO: `/v3/projects/0490ee8cdce3475bae66d5f1446d0cb8` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:20.830061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0490ee8cdce3475bae66d5f1446d0cb8)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:20.833293 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:20.887573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0490ee8cdce3475bae66d5f1446d0cb8', 'request_id': 'req-4978a824-59af-4f24-b405-05a16b812c63'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.888958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:20.895500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0490ee8cdce3475bae66d5f1446d0cb8', 'request_id': 'req-4978a824-59af-4f24-b405-05a16b812c63'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.905599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0490ee8cdce3475bae66d5f1446d0cb8', 'request_id': 'req-4978a824-59af-4f24-b405-05a16b812c63'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.917510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] The token cache is being invalidate because project 0490ee8cdce3475bae66d5f1446d0cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:20.917804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.918451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-4978a824-59af-4f24-b405-05a16b812c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:20.923441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1275/2568] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:20 2022] DELETE /identity/v3/projects/0490ee8cdce3475bae66d5f1446d0cb8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:20.926515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a865a-9ec6-4336-b685-75f62ad40876 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:20.927045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a865a-9ec6-4336-b685-75f62ad40876 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:20.928681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a865a-9ec6-4336-b685-75f62ad40876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:20.956455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9f2a865a-9ec6-4336-b685-75f62ad40876 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:20.957987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9f2a865a-9ec6-4336-b685-75f62ad40876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:21.023307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1294/2569] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:21.031942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ca93-94d7-4d82-a7a3-17ac3fda0afa None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.032238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ca93-94d7-4d82-a7a3-17ac3fda0afa None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.032519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ca93-94d7-4d82-a7a3-17ac3fda0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.053177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-6bc2ca93-94d7-4d82-a7a3-17ac3fda0afa None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:21.054535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-6bc2ca93-94d7-4d82-a7a3-17ac3fda0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:21.062986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1276/2570] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:21.067576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a865a-9ec6-4336-b685-75f62ad40876 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.078760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a865a-9ec6-4336-b685-75f62ad40876 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.083727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.084434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.084726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.085013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.085775 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:21.086092 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.087795 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.105216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1295/2571] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:52:21.106373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ca93-94d7-4d82-a7a3-17ac3fda0afa None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.117154 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ca93-94d7-4d82-a7a3-17ac3fda0afa None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.122109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.122806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.123101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.123559 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.124268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.126192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.168588 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1277/2572] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:21 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:21.170171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.183284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491f984-e3a3-4e48-b39f-bcaf2470b4f7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.244575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.245257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.245575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.245862 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.246719 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.248874 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.274696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1296/2573] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:21 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:21.275917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.289271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446add6b-c4dd-4ef1-8b56-b48e14f21e62 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.294017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.294686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.295058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.295386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.296118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.298339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.310604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1278/2574] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:21.314676 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.326836 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555ca4-f3c5-4723-a3e8-92b716659e86 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.332562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebe42f-c0f4-4162-9d19-a6789446d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.333177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebe42f-c0f4-4162-9d19-a6789446d3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.333470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebe42f-c0f4-4162-9d19-a6789446d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.333819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebe42f-c0f4-4162-9d19-a6789446d3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.335077 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebe42f-c0f4-4162-9d19-a6789446d3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.336721 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebe42f-c0f4-4162-9d19-a6789446d3c0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.350695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1297/2575] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:21.354495 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.367901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89befffd-0b00-4579-b17a-3b722cb85921 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.373028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.373914 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.374206 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.374487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] PATH_INFO: `/v3/projects/81fafc6074e94c108385cbd52a351c40/users/010ee56ad5ef4da0bbcd2940723f957e/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.393709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fafc6074e94c108385cbd52a351c40, user_id=010ee56ad5ef4da0bbcd2940723f957e, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.397097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.416594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1279/2576] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:21 2022] PUT /identity/v3/projects/81fafc6074e94c108385cbd52a351c40/users/010ee56ad5ef4da0bbcd2940723f957e/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:21.428611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d21f-115b-424a-af76-1a6114134c40 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.429342 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d21f-115b-424a-af76-1a6114134c40 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.429849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d21f-115b-424a-af76-1a6114134c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.470891 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-5437d21f-115b-424a-af76-1a6114134c40 None None] MFA Rules not processed for user `010ee56ad5ef4da0bbcd2940723f957e`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:21.472188 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5437d21f-115b-424a-af76-1a6114134c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:21.537972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:21.626131 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1298/2577] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:21.630212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.720957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b7638-e705-4ee5-9007-a6a4c9724690 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.726737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.727444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.727736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.728021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.728758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.730723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.762842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1280/2578] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:21 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:21.763933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d21f-115b-424a-af76-1a6114134c40 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.775535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d21f-115b-424a-af76-1a6114134c40 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.847444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.848488 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.848943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.849837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.850886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.853425 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.879230 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1299/2579] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:21 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:21.883374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.894946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab581048-6f0a-4770-8f2b-6dffada802ca admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.901515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.902288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.902745 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.903130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.904156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.906328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.923609 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1281/2580] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:52:21.925362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:21.939023 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3c4c5-7c39-442f-82f3-1a1594e3c92e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:21.945083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:21.945973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:21.946255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:21.946530 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] PATH_INFO: `/v3/projects/02ba4ed28eea4be3acddb102a760631b/users/28ce71d028d54f369d545aecd4da1a8a/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:21.968792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ba4ed28eea4be3acddb102a760631b, user_id=28ce71d028d54f369d545aecd4da1a8a, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:21.972871 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:21.998317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1300/2581] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:21 2022] PUT /identity/v3/projects/02ba4ed28eea4be3acddb102a760631b/users/28ce71d028d54f369d545aecd4da1a8a/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:22.000437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:22.014674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ed47-fa72-4724-9ae9-e2222a4f8fa2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:22.087185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:22.113106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fb0c4-6019-4697-aff4-c73779e3ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:22.113740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb0c4-6019-4697-aff4-c73779e3ab48 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:22.114168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb0c4-6019-4697-aff4-c73779e3ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:22.114378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb0c4-6019-4697-aff4-c73779e3ab48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:22.115185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb0c4-6019-4697-aff4-c73779e3ab48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:22.117429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb0c4-6019-4697-aff4-c73779e3ab48 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:22.128602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1282/2582] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:22.133169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:22.148274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773f6f-7806-44ad-a935-866b6d8342c8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:22.156232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:22.157697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:22.158251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:22.158624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] PATH_INFO: `/v3/projects/02ba4ed28eea4be3acddb102a760631b/users/28ce71d028d54f369d545aecd4da1a8a/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:22.162366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ba4ed28eea4be3acddb102a760631b, user_id=28ce71d028d54f369d545aecd4da1a8a, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:22.166201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:22.183388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1301/2583] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:22 2022] PUT /identity/v3/projects/02ba4ed28eea4be3acddb102a760631b/users/28ce71d028d54f369d545aecd4da1a8a/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:22.192410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc052-48e1-47e9-8d07-cfb2f0017d7b None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:22.192709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc052-48e1-47e9-8d07-cfb2f0017d7b None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:22.193545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc052-48e1-47e9-8d07-cfb2f0017d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:22.224530 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4fbcc052-48e1-47e9-8d07-cfb2f0017d7b None None] MFA Rules not processed for user `28ce71d028d54f369d545aecd4da1a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:22.225903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4fbcc052-48e1-47e9-8d07-cfb2f0017d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:22.311646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1283/2584] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:22.329222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:22.331049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:22.394122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df04e6-044c-46ed-a86c-fa484d4ab9ef admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:22.399181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d67e5-9201-488f-b9b6-46b1d11d994b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:22.400139 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d67e5-9201-488f-b9b6-46b1d11d994b service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:22.400627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d67e5-9201-488f-b9b6-46b1d11d994b service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:22.401107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d67e5-9201-488f-b9b6-46b1d11d994b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:22.441416 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:22.467973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d67e5-9201-488f-b9b6-46b1d11d994b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:22.469424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d67e5-9201-488f-b9b6-46b1d11d994b service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:22.484480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1302/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:25.248872 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcc052-48e1-47e9-8d07-cfb2f0017d7b None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:25.259941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcc052-48e1-47e9-8d07-cfb2f0017d7b None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:25.263958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:25.264742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:25.265127 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:25.265507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:25.278002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:25.280589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:25.297549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1284/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:52:27.868130 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:27.868631 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:27.868745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:27.885804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:27.887136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:27.943186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1303/2587] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 23 13:52:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:27.955806 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:27.957195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:28.029316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb4885-b8aa-4e97-ae6d-0a62116f534a service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:28.034645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:28.035336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:28.035691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:28.035887 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:28.044770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:28.046357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:28.055280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1285/2588] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:52:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:52:29.991728 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:29.993227 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:30.058179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81671cf-396a-406a-a280-ad3727a9b118 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.062612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.063512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.063801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.064078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] PATH_INFO: `/v3/users/fa1fe2232ee44c2d834941120c042d17` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.065269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1fe2232ee44c2d834941120c042d17)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.067248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.112094 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1fe2232ee44c2d834941120c042d17'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.124334 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1fe2232ee44c2d834941120c042d17'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.124986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1fe2232ee44c2d834941120c042d17'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.132126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1fe2232ee44c2d834941120c042d17'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.138927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-2778693f-5e38-4d2b-90df-f330ce008827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1fe2232ee44c2d834941120c042d17'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.142069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:30.147054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1304/2589] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:29 2022] DELETE /identity/v3/users/fa1fe2232ee44c2d834941120c042d17 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:30.315863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:30.327059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d647f-de9e-4500-9023-4eec964ac29b service swift] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.379102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:30.391710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.392567 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.392851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.393128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] PATH_INFO: `/v3/projects/ef682ab4e1004157904d206a75da0ee0` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.394291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef682ab4e1004157904d206a75da0ee0)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.396230 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.442978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef682ab4e1004157904d206a75da0ee0', 'request_id': 'req-0ee9bc85-0650-4904-b6c9-405d57fd157a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.449425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef682ab4e1004157904d206a75da0ee0', 'request_id': 'req-0ee9bc85-0650-4904-b6c9-405d57fd157a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.457100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef682ab4e1004157904d206a75da0ee0', 'request_id': 'req-0ee9bc85-0650-4904-b6c9-405d57fd157a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.469324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] The token cache is being invalidate because project ef682ab4e1004157904d206a75da0ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:30.469638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.470354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0ee9bc85-0650-4904-b6c9-405d57fd157a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:30.471992 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1286/2590] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:30 2022] DELETE /identity/v3/projects/ef682ab4e1004157904d206a75da0ee0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:30.478113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f2c05-5852-43c4-a598-8495f3f321c4 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.478413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f2c05-5852-43c4-a598-8495f3f321c4 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.478697 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f2c05-5852-43c4-a598-8495f3f321c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.504789 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e00f2c05-5852-43c4-a598-8495f3f321c4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:30.506180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e00f2c05-5852-43c4-a598-8495f3f321c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:30.574314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1305/2591] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:30.583011 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f77eb-82c4-4b3b-87da-fb9b4f0eb0de None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.583954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f77eb-82c4-4b3b-87da-fb9b4f0eb0de None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.584414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f77eb-82c4-4b3b-87da-fb9b4f0eb0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.605083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-437f77eb-82c4-4b3b-87da-fb9b4f0eb0de None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:30.606415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-437f77eb-82c4-4b3b-87da-fb9b4f0eb0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:30.614478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1287/2592] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:52:30.619667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f2c05-5852-43c4-a598-8495f3f321c4 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:30.631171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f2c05-5852-43c4-a598-8495f3f321c4 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.642123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.642778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.643061 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.643389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.644122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:30.644431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.646703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.664770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f77eb-82c4-4b3b-87da-fb9b4f0eb0de None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:30.666161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1306/2593] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:52:30.674030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f77eb-82c4-4b3b-87da-fb9b4f0eb0de None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.679315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.680031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.680347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.680641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.681407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.683488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.709274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1288/2594] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:30 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:30.713492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:30.723347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ec383-b2e3-4b6f-b3b4-05dd550e84e2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.781125 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.781792 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.782080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.782418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.783128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.785082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.807529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1307/2595] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:30 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:30.811564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:30.821993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa3528-1e5a-4c63-902b-0050c1855593 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.826616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.827233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.827521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.827801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.828516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.830105 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.840950 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1289/2596] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:30.844724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:30.854611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17043f4-16fa-4f68-a734-8bb400682935 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.859140 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cda7f-1db7-4981-b5a0-6bacc131484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.860071 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cda7f-1db7-4981-b5a0-6bacc131484c admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.860241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cda7f-1db7-4981-b5a0-6bacc131484c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.860498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cda7f-1db7-4981-b5a0-6bacc131484c admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.861224 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cda7f-1db7-4981-b5a0-6bacc131484c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.862793 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cda7f-1db7-4981-b5a0-6bacc131484c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.872616 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1308/2597] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:30.876566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:30.886592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce5f3d-0060-4d77-8a20-0eae4c1e513c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:30.891114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:30.892004 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.892296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.892575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] PATH_INFO: `/v3/projects/e1a2c343d1754619ae65cb1c5d463579/users/b8a161bcbc924575a127ff70a2b67a03/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.907494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a2c343d1754619ae65cb1c5d463579, user_id=b8a161bcbc924575a127ff70a2b67a03, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:30.910114 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:30.922815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1290/2598] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:30 2022] PUT /identity/v3/projects/e1a2c343d1754619ae65cb1c5d463579/users/b8a161bcbc924575a127ff70a2b67a03/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:30.933124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80832-02f8-4ce9-8a4b-41f80ae0da91 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:30.933413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80832-02f8-4ce9-8a4b-41f80ae0da91 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:30.933693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80832-02f8-4ce9-8a4b-41f80ae0da91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:30.960048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-08e80832-02f8-4ce9-8a4b-41f80ae0da91 None None] MFA Rules not processed for user `b8a161bcbc924575a127ff70a2b67a03`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:30.961259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-08e80832-02f8-4ce9-8a4b-41f80ae0da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:31.013643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:31.024258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1309/2599] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:31.035542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:31.037289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:31.095312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ec545-5ef4-4e47-ac60-fda55f5d7735 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:31.099383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd732dc0-b25e-4db1-81ee-42f38ee5c75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:31.100051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd732dc0-b25e-4db1-81ee-42f38ee5c75e service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:31.100354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd732dc0-b25e-4db1-81ee-42f38ee5c75e service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:31.100632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd732dc0-b25e-4db1-81ee-42f38ee5c75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:31.108789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd732dc0-b25e-4db1-81ee-42f38ee5c75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:31.110211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd732dc0-b25e-4db1-81ee-42f38ee5c75e service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:31.118853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1291/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:33.643502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e80832-02f8-4ce9-8a4b-41f80ae0da91 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:33.705645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e80832-02f8-4ce9-8a4b-41f80ae0da91 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:33.710205 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:33.711072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:33.711398 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:33.711682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] PATH_INFO: `/v3/users/b8a161bcbc924575a127ff70a2b67a03` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:33.712854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a161bcbc924575a127ff70a2b67a03)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:33.714806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:33.760614 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a161bcbc924575a127ff70a2b67a03'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:33.772487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a161bcbc924575a127ff70a2b67a03'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:33.773237 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a161bcbc924575a127ff70a2b67a03'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:33.780693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a161bcbc924575a127ff70a2b67a03'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:33.787886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a161bcbc924575a127ff70a2b67a03'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:33.794235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1310/2601] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:33 2022] DELETE /identity/v3/users/b8a161bcbc924575a127ff70a2b67a03 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:33.798736 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:33.799192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:33.799338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:33.816383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:33.817573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:33.826439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:33.878354 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1292/2602] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:33.887966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:33.889349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:33.946857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef974f8f-fb24-4ce5-81d9-801bc7f656a5 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:33.950502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747caef-8432-4c17-87ac-1b9ce4d20594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:33.951146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747caef-8432-4c17-87ac-1b9ce4d20594 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:33.951477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747caef-8432-4c17-87ac-1b9ce4d20594 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:33.951760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747caef-8432-4c17-87ac-1b9ce4d20594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:33.961225 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747caef-8432-4c17-87ac-1b9ce4d20594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:33.962627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747caef-8432-4c17-87ac-1b9ce4d20594 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:33.971952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1311/2603] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:34.239446 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.240894 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:34.257461 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a0b3-930b-484b-aafc-5034e06307fd None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.265443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.266315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.266604 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.266886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] PATH_INFO: `/v3/projects/e1a2c343d1754619ae65cb1c5d463579` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.268126 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a2c343d1754619ae65cb1c5d463579)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.270076 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.324151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a2c343d1754619ae65cb1c5d463579', 'request_id': 'req-59636b30-5491-4882-898b-3effcf196169'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:34.330738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a2c343d1754619ae65cb1c5d463579', 'request_id': 'req-59636b30-5491-4882-898b-3effcf196169'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:34.338616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a2c343d1754619ae65cb1c5d463579', 'request_id': 'req-59636b30-5491-4882-898b-3effcf196169'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:34.349246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] The token cache is being invalidate because project e1a2c343d1754619ae65cb1c5d463579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:34.349557 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:34.350194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-59636b30-5491-4882-898b-3effcf196169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:34.351747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1293/2604] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:34 2022] DELETE /identity/v3/projects/e1a2c343d1754619ae65cb1c5d463579 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:34.357016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5cb28-7491-4f18-ba08-e6d48bf39cc8 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.357315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5cb28-7491-4f18-ba08-e6d48bf39cc8 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.357605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5cb28-7491-4f18-ba08-e6d48bf39cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.375319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-a7b5cb28-7491-4f18-ba08-e6d48bf39cc8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:34.376513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a7b5cb28-7491-4f18-ba08-e6d48bf39cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:34.389822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:34.441156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1312/2605] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:34.450014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b58a4-f6b6-4957-a959-c1886b686bb8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.450308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b58a4-f6b6-4957-a959-c1886b686bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.450620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b58a4-f6b6-4957-a959-c1886b686bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.473043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0b7b58a4-f6b6-4957-a959-c1886b686bb8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:34.474423 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0b7b58a4-f6b6-4957-a959-c1886b686bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:34.482507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1294/2606] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:34.486812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5cb28-7491-4f18-ba08-e6d48bf39cc8 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.496399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5cb28-7491-4f18-ba08-e6d48bf39cc8 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.500954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.501604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.501892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.502176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.502902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:34.503236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.504828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.517003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1313/2607] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:52:34.521065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b58a4-f6b6-4957-a959-c1886b686bb8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.531839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b58a4-f6b6-4957-a959-c1886b686bb8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.536570 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.537227 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.537515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.537795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.539029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.540967 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.569386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1295/2608] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:34 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:34.573966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.583565 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773717b5-3084-4b4b-ae67-15d5d831d137 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.641787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.642455 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.642739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.643015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.643723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.645619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.665982 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1314/2609] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:34 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:52:34.670014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.680205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c586b2-9915-4378-813e-145b8e8935b5 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.684677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.685414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.685699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.685977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.686695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.688360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.698936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1296/2610] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:34.702491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.712651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89782d-23d0-4add-8165-ce09ab2cc7fd admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.717145 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953aa232-b1f2-4b5d-bc54-4b807e046995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.717787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aa232-b1f2-4b5d-bc54-4b807e046995 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.718072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aa232-b1f2-4b5d-bc54-4b807e046995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.718352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aa232-b1f2-4b5d-bc54-4b807e046995 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.719064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953aa232-b1f2-4b5d-bc54-4b807e046995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.720668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953aa232-b1f2-4b5d-bc54-4b807e046995 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.730890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1315/2611] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:34.734638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.744552 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092734-50c5-4fc9-8e1e-ef61f5e916d6 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.749947 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.750895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.751186 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.751593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] PATH_INFO: `/v3/projects/149f2dc3a1614cc1bbadefa440dac6a8/users/f9f40c19e5b742ee8555147cf8ee6842/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.766274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=149f2dc3a1614cc1bbadefa440dac6a8, user_id=f9f40c19e5b742ee8555147cf8ee6842, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.768932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.781936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1297/2612] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:34 2022] PUT /identity/v3/projects/149f2dc3a1614cc1bbadefa440dac6a8/users/f9f40c19e5b742ee8555147cf8ee6842/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:34.792529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.792821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.793103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.818809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] MFA Rules not processed for user `f9f40c19e5b742ee8555147cf8ee6842`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:34.820046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:34.884610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1316/2613] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:34.895933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:34.898205 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:34.937413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:34.956874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732c0e1-9a4d-462a-85b7-4eae985e5ecb admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:34.961183 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e68e1-720e-4c9a-b62b-812141c600e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:34.961848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e68e1-720e-4c9a-b62b-812141c600e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:34.962132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e68e1-720e-4c9a-b62b-812141c600e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:34.962406 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e68e1-720e-4c9a-b62b-812141c600e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:34.970510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e68e1-720e-4c9a-b62b-812141c600e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:34.971970 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e68e1-720e-4c9a-b62b-812141c600e5 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:34.981218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1298/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:37.903522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:37.904977 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:37.920794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:37.973593 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098425c-3c6e-4829-962c-954fbf01b629 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:37.978637 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:37.979536 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:37.979823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:37.980102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] PATH_INFO: `/v3/users/010ee56ad5ef4da0bbcd2940723f957e` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:37.981276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010ee56ad5ef4da0bbcd2940723f957e)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:37.983228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:38.026706 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010ee56ad5ef4da0bbcd2940723f957e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.039500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010ee56ad5ef4da0bbcd2940723f957e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.040224 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010ee56ad5ef4da0bbcd2940723f957e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.047109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010ee56ad5ef4da0bbcd2940723f957e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.054904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010ee56ad5ef4da0bbcd2940723f957e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.060732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1317/2615] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:37 2022] DELETE /identity/v3/users/010ee56ad5ef4da0bbcd2940723f957e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:38.065380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:38.065848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:38.066082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:38.082591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:38.083804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:38.143181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1299/2616] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:38.152974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:38.154364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:38.211856 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2703c8-2055-447a-86f3-597c812182d4 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:38.215473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:38.216108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:38.216394 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:38.216670 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:38.225391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:38.227379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:38.236512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1318/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:38.503789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:38.505239 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:38.517436 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe555e0-d1fb-4460-9742-10d42146e01e None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:38.522098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:38.523543 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:38.523826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:38.524367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] PATH_INFO: `/v3/projects/81fafc6074e94c108385cbd52a351c40` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:38.525544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fafc6074e94c108385cbd52a351c40)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:38.527480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:38.575013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fafc6074e94c108385cbd52a351c40', 'request_id': 'req-26696daf-2d57-4db5-868a-6bea6493741f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.581319 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fafc6074e94c108385cbd52a351c40', 'request_id': 'req-26696daf-2d57-4db5-868a-6bea6493741f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.588476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fafc6074e94c108385cbd52a351c40', 'request_id': 'req-26696daf-2d57-4db5-868a-6bea6493741f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.598724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] The token cache is being invalidate because project 81fafc6074e94c108385cbd52a351c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:38.599017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.599700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.601266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1300/2618] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:38 2022] DELETE /identity/v3/projects/81fafc6074e94c108385cbd52a351c40 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:38.605229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:38.614879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4d91a-584d-4d8a-ad1f-3569e425cede service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:38.647878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:38.673855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:38.674715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:38.675001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:38.675368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] PATH_INFO: `/v3/users/28ce71d028d54f369d545aecd4da1a8a` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:38.676540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ce71d028d54f369d545aecd4da1a8a)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:38.678438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:38.722004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ce71d028d54f369d545aecd4da1a8a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.734452 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ce71d028d54f369d545aecd4da1a8a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.735123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ce71d028d54f369d545aecd4da1a8a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.742115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ce71d028d54f369d545aecd4da1a8a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.748780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f149188d-cb3b-4956-ae77-28dfcfe42b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ce71d028d54f369d545aecd4da1a8a'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:38.754838 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1319/2619] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:38 2022] DELETE /identity/v3/users/28ce71d028d54f369d545aecd4da1a8a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:39.052204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.054443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:39.070948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26696daf-2d57-4db5-868a-6bea6493741f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.150630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.151438 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.151723 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.152007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] PATH_INFO: `/v3/projects/02ba4ed28eea4be3acddb102a760631b` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.154971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ba4ed28eea4be3acddb102a760631b)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.156939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.159569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:39.204284 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ba4ed28eea4be3acddb102a760631b', 'request_id': 'req-6c0d6a26-c447-407c-987e-16a7d72aef6e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:39.210715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ba4ed28eea4be3acddb102a760631b', 'request_id': 'req-6c0d6a26-c447-407c-987e-16a7d72aef6e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:39.218273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ba4ed28eea4be3acddb102a760631b', 'request_id': 'req-6c0d6a26-c447-407c-987e-16a7d72aef6e'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:39.230024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] The token cache is being invalidate because project 02ba4ed28eea4be3acddb102a760631b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:39.230323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:39.230978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-6c0d6a26-c447-407c-987e-16a7d72aef6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:39.232534 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1301/2620] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:39 2022] DELETE /identity/v3/projects/02ba4ed28eea4be3acddb102a760631b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:39.237521 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05cf40-2d68-4d32-b86a-8ab744e318bf None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.237986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05cf40-2d68-4d32-b86a-8ab744e318bf None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.238097 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05cf40-2d68-4d32-b86a-8ab744e318bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.256403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4c05cf40-2d68-4d32-b86a-8ab744e318bf None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:39.258247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4c05cf40-2d68-4d32-b86a-8ab744e318bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:39.316532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1320/2621] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:52:39.326672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d97a5-0417-43bd-99f5-adc4588a266a None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.326964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d97a5-0417-43bd-99f5-adc4588a266a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.327278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d97a5-0417-43bd-99f5-adc4588a266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.345187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-0a9d97a5-0417-43bd-99f5-adc4588a266a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:39.346379 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0a9d97a5-0417-43bd-99f5-adc4588a266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:39.354211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1302/2622] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:39.358391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05cf40-2d68-4d32-b86a-8ab744e318bf None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.368444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05cf40-2d68-4d32-b86a-8ab744e318bf None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.372935 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.373573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.373876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.374133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.374845 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:39.375151 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.376763 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.388695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1321/2623] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:52:39.392818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d97a5-0417-43bd-99f5-adc4588a266a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.402197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d97a5-0417-43bd-99f5-adc4588a266a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.407139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.407818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.408111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.408389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.409100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.410999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.445837 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1303/2624] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:39 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:39.449939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.459588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e5f81-ffc7-4db4-a60e-4ef21e5e6aa2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.500393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:39.517948 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.518619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.518929 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.519231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.519936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.521846 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.541877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1322/2625] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:39 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:39.545901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.556631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43679b3-a9c2-474e-b67b-c60e30a89550 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.561223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.561877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.562164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.562445 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.563161 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.564795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.574608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1304/2626] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:39.578305 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.588591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b31c81-0ddc-4101-b50d-4740ccf55d27 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.593275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b187d1-a611-4dc7-ba6f-318264228a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.593927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b187d1-a611-4dc7-ba6f-318264228a28 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.594218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b187d1-a611-4dc7-ba6f-318264228a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.594503 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b187d1-a611-4dc7-ba6f-318264228a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.595250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b187d1-a611-4dc7-ba6f-318264228a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.596862 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b187d1-a611-4dc7-ba6f-318264228a28 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.607533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1323/2627] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:39.611342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.621632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5dda-1dfa-4e9b-85ae-f8124e14139c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.626246 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.627111 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.627426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.627707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] PATH_INFO: `/v3/projects/8bc7e6ddd55049f48e9ffd6f36450f39/users/36add2b5e81e438098baced35bef97cf/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.643144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc7e6ddd55049f48e9ffd6f36450f39, user_id=36add2b5e81e438098baced35bef97cf, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.645844 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.659428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1305/2628] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:39 2022] PUT /identity/v3/projects/8bc7e6ddd55049f48e9ffd6f36450f39/users/36add2b5e81e438098baced35bef97cf/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:39.669990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d413d-4b7b-4dfe-af03-b579faee096b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.670292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d413d-4b7b-4dfe-af03-b579faee096b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.670581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d413d-4b7b-4dfe-af03-b579faee096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.697448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-504d413d-4b7b-4dfe-af03-b579faee096b None None] MFA Rules not processed for user `36add2b5e81e438098baced35bef97cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:39.698652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-504d413d-4b7b-4dfe-af03-b579faee096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:39.760939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1324/2629] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:39.765320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.825971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55408105-d598-46fd-ba12-44772f68a73a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.830563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.831243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.831541 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.831816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.832503 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.834393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.859393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1306/2630] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:39 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:39.863548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d413d-4b7b-4dfe-af03-b579faee096b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.874177 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d413d-4b7b-4dfe-af03-b579faee096b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.931263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.931854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.932136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.932412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.933083 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.934978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.954526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1325/2631] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:39 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:39.958452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:39.965518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:39.969568 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf7b79-762f-4720-ab46-071e638b9429 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:39.975255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:39.976933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:39.977331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:39.977710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:39.978516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:39.980297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:39.990889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1307/2632] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:39.994919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:40.004606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b4a71-9f5f-4312-a05e-a07eeb6075b6 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:40.009216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:40.010080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:40.010362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:40.010640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] PATH_INFO: `/v3/projects/69c1b0ad3bd14730829fdc276d70397d/users/2c68088a038f4e2f8ca9810066dacd70/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:40.025543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c1b0ad3bd14730829fdc276d70397d, user_id=2c68088a038f4e2f8ca9810066dacd70, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:40.028191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:40.040765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1326/2633] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:39 2022] PUT /identity/v3/projects/69c1b0ad3bd14730829fdc276d70397d/users/2c68088a038f4e2f8ca9810066dacd70/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:40.044547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:40.054341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99b33-bd01-42b8-ba10-a613dd7a2057 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:40.114948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634816f5-86a5-4cab-8512-1b662ce623f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:40.115726 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634816f5-86a5-4cab-8512-1b662ce623f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:40.116140 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634816f5-86a5-4cab-8512-1b662ce623f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:40.116487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634816f5-86a5-4cab-8512-1b662ce623f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:40.117280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634816f5-86a5-4cab-8512-1b662ce623f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:40.118964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634816f5-86a5-4cab-8512-1b662ce623f0 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:40.129242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1308/2634] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:40.133324 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:40.144031 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d79b6f-9369-4f93-a755-2008e49775c1 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:40.150176 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:40.151221 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:40.151599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:40.151888 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] PATH_INFO: `/v3/projects/69c1b0ad3bd14730829fdc276d70397d/users/2c68088a038f4e2f8ca9810066dacd70/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:40.153966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c1b0ad3bd14730829fdc276d70397d, user_id=2c68088a038f4e2f8ca9810066dacd70, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:40.156672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:40.167738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1327/2635] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:40 2022] PUT /identity/v3/projects/69c1b0ad3bd14730829fdc276d70397d/users/2c68088a038f4e2f8ca9810066dacd70/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:40.178885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5982-b7cc-4bf2-beda-a1ebb2b48a29 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:40.179365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5982-b7cc-4bf2-beda-a1ebb2b48a29 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:40.179833 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5982-b7cc-4bf2-beda-a1ebb2b48a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:40.207299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-bf7c5982-b7cc-4bf2-beda-a1ebb2b48a29 None None] MFA Rules not processed for user `2c68088a038f4e2f8ca9810066dacd70`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:40.208453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-bf7c5982-b7cc-4bf2-beda-a1ebb2b48a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:40.280444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1309/2636] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:40.292068 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:40.293975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:40.299548 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:40.375168 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe942-f038-4aca-878e-cf6d60477836 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:40.378909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:40.379595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:40.379883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:40.380162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:40.436943 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:40.438379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:40.447833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1328/2637] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:52:41.787439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c5982-b7cc-4bf2-beda-a1ebb2b48a29 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:41.796977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c5982-b7cc-4bf2-beda-a1ebb2b48a29 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:41.800454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c100de4-de28-4ea2-adb3-26e3219a727f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:41.801087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100de4-de28-4ea2-adb3-26e3219a727f service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:41.801371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100de4-de28-4ea2-adb3-26e3219a727f service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:41.801647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100de4-de28-4ea2-adb3-26e3219a727f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:41.810683 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c100de4-de28-4ea2-adb3-26e3219a727f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:41.812138 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c100de4-de28-4ea2-adb3-26e3219a727f service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:41.822051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1310/2638] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:45.587119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:45.650586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5162e-91e2-4666-9ff1-7c10b8ac65ed service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:45.655162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:45.656060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:45.656354 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:45.656634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] PATH_INFO: `/v3/users/36add2b5e81e438098baced35bef97cf` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:45.657816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36add2b5e81e438098baced35bef97cf)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:45.659951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:45.707627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36add2b5e81e438098baced35bef97cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:45.715362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:45.720738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36add2b5e81e438098baced35bef97cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:45.721671 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36add2b5e81e438098baced35bef97cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:45.729013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36add2b5e81e438098baced35bef97cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:45.736292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36add2b5e81e438098baced35bef97cf'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:45.742844 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1329/2639] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:45 2022] DELETE /identity/v3/users/36add2b5e81e438098baced35bef97cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:45.747274 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:45.747763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:45.747873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:45.764990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:45.766180 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:45.823219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1311/2640] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:45.832812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:45.834245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:45.890438 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07156136-df41-4a38-8e07-fc6f1f1b4826 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:45.894056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:45.894698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:45.894986 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:45.895310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:45.904993 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:45.906415 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:45.916357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1330/2641] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:46.172727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:46.173852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:46.181128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=100 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:46.187615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2fa48-ab7a-4563-a76a-e211a41384ec None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:46.192212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:46.193265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:46.193616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:46.193961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] PATH_INFO: `/v3/projects/8bc7e6ddd55049f48e9ffd6f36450f39` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:46.195888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc7e6ddd55049f48e9ffd6f36450f39)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:46.198200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:46.244795 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc7e6ddd55049f48e9ffd6f36450f39', 'request_id': 'req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.250776 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc7e6ddd55049f48e9ffd6f36450f39', 'request_id': 'req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.258496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc7e6ddd55049f48e9ffd6f36450f39', 'request_id': 'req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.269619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] The token cache is being invalidate because project 8bc7e6ddd55049f48e9ffd6f36450f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:46.269908 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.270542 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.272095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1312/2642] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:46 2022] DELETE /identity/v3/projects/8bc7e6ddd55049f48e9ffd6f36450f39 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:46.277046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:46.286490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2a16d-b865-4102-969b-091c10e466c2 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:46.341682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:46.342543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:46.342997 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:46.343199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] PATH_INFO: `/v3/users/2c68088a038f4e2f8ca9810066dacd70` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:46.344286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c68088a038f4e2f8ca9810066dacd70)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:46.346196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:46.390268 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c68088a038f4e2f8ca9810066dacd70'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.402203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c68088a038f4e2f8ca9810066dacd70'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.402864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c68088a038f4e2f8ca9810066dacd70'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.409916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c68088a038f4e2f8ca9810066dacd70'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.417248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c1b75f5b-692c-468b-82eb-1394d564c16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c68088a038f4e2f8ca9810066dacd70'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.418684 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:46.424235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1331/2643] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:46 2022] DELETE /identity/v3/users/2c68088a038f4e2f8ca9810066dacd70 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:46.693514 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:46.695672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:46.711707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a55a-02ee-463b-b25c-8ffa6cffa9dc admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:46.789734 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:46.790899 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:46.791361 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:46.791747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] PATH_INFO: `/v3/projects/69c1b0ad3bd14730829fdc276d70397d` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:46.793061 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c1b0ad3bd14730829fdc276d70397d)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:46.795194 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:46.846593 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c1b0ad3bd14730829fdc276d70397d', 'request_id': 'req-0268936e-7001-4533-9a1a-0e65d9232c7f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.852829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c1b0ad3bd14730829fdc276d70397d', 'request_id': 'req-0268936e-7001-4533-9a1a-0e65d9232c7f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.861286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c1b0ad3bd14730829fdc276d70397d', 'request_id': 'req-0268936e-7001-4533-9a1a-0e65d9232c7f'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.874710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] The token cache is being invalidate because project 69c1b0ad3bd14730829fdc276d70397d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:46.875006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.875697 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-0268936e-7001-4533-9a1a-0e65d9232c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:46.877326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1313/2644] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:46 2022] DELETE /identity/v3/projects/69c1b0ad3bd14730829fdc276d70397d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:46.883999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf56c1-a4f4-4e99-aa83-692f7f45153a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:46.884500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf56c1-a4f4-4e99-aa83-692f7f45153a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:46.884692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf56c1-a4f4-4e99-aa83-692f7f45153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:46.904972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-bbaf56c1-a4f4-4e99-aa83-692f7f45153a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:46.906063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-bbaf56c1-a4f4-4e99-aa83-692f7f45153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:46.971095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1332/2645] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:52:46.978780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8d36-d615-410b-a3cd-a5541743a6f8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:46.979331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8d36-d615-410b-a3cd-a5541743a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:46.979622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8d36-d615-410b-a3cd-a5541743a6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.004166 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-e07e8d36-d615-410b-a3cd-a5541743a6f8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:47.005382 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-e07e8d36-d615-410b-a3cd-a5541743a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:47.013879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1314/2646] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:52:47.018233 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf56c1-a4f4-4e99-aa83-692f7f45153a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.031649 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf56c1-a4f4-4e99-aa83-692f7f45153a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.036422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.037026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.037320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.037619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.038881 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:47.039365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.040965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.053011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1333/2647] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:52:47.057818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e8d36-d615-410b-a3cd-a5541743a6f8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.067195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e8d36-d615-410b-a3cd-a5541743a6f8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.072352 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.073007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.073296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.073574 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.074377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.076386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.080727 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:47.106730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1315/2648] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:47.110767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.121196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44776ed-4757-42fc-8bb2-e249a6b31f12 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.177147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.177819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.178103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.178384 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.179701 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.181634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.201532 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1334/2649] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:47.205413 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.215346 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8943ada-3c34-40a6-865c-796188f5bbfc admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.219959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.220716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.221001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.221278 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.221998 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.223647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.234675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1316/2650] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:47.238419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.248898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0592faa-154f-46da-b483-873b4508ae9f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.253489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ba9f0-8a94-4888-ae1f-69312f996965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.254141 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba9f0-8a94-4888-ae1f-69312f996965 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.254429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba9f0-8a94-4888-ae1f-69312f996965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.254714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba9f0-8a94-4888-ae1f-69312f996965 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.255469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ba9f0-8a94-4888-ae1f-69312f996965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.257040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ba9f0-8a94-4888-ae1f-69312f996965 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.266727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1335/2651] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:47.270765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.281616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b4804-e345-4802-9434-7f5d99c1b23d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.286219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.287185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.287444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.287728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] PATH_INFO: `/v3/projects/4ffb69db1159406faba3228d56a1f3b5/users/95fe69087608430e8bb7af4d74cbeed0/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.303584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffb69db1159406faba3228d56a1f3b5, user_id=95fe69087608430e8bb7af4d74cbeed0, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.306793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.322448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1317/2652] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:47 2022] PUT /identity/v3/projects/4ffb69db1159406faba3228d56a1f3b5/users/95fe69087608430e8bb7af4d74cbeed0/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:47.333172 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72670fbd-4354-4797-b6c7-c0159c998895 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.333492 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72670fbd-4354-4797-b6c7-c0159c998895 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.333781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72670fbd-4354-4797-b6c7-c0159c998895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.364312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-72670fbd-4354-4797-b6c7-c0159c998895 None None] MFA Rules not processed for user `95fe69087608430e8bb7af4d74cbeed0`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:47.365542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-72670fbd-4354-4797-b6c7-c0159c998895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:47.427538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:47.438444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1336/2653] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:47.442929 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.506577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f76a2-ae58-4f66-9292-07a048d0da0d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.511195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.511882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.512168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.512452 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.513137 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.515041 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.541419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1318/2654] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:47.545756 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72670fbd-4354-4797-b6c7-c0159c998895 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.558458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72670fbd-4354-4797-b6c7-c0159c998895 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.617513 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.618196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.618531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.618816 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.619563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.621491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.644855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1337/2655] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:47.646492 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.659148 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685ba5a-0d2a-451a-87a8-1044d16d7966 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.664424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.665091 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.665377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.665655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.666391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.668037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.678498 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1319/2656] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:52:47.682586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.692466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c29ab-aba8-4f38-b79f-54a609cee8f7 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.697875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa07f6-1d90-4ab2-b64e-025824919655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.698553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa07f6-1d90-4ab2-b64e-025824919655 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.698833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa07f6-1d90-4ab2-b64e-025824919655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.699285 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa07f6-1d90-4ab2-b64e-025824919655 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.700074 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa07f6-1d90-4ab2-b64e-025824919655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.701715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa07f6-1d90-4ab2-b64e-025824919655 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.712919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1338/2657] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:47.717108 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.727178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1076-1b80-48d0-8da8-24f42f88faf7 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.731660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.732539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.732828 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.733107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] PATH_INFO: `/v3/projects/d28e4e02b9514340bf3848f03449214e/users/4c22549f7c90414db53901edd7b55c69/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.748109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28e4e02b9514340bf3848f03449214e, user_id=4c22549f7c90414db53901edd7b55c69, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.750793 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.763974 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1320/2658] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:47 2022] PUT /identity/v3/projects/d28e4e02b9514340bf3848f03449214e/users/4c22549f7c90414db53901edd7b55c69/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:47.776234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e892-8f38-403b-9908-cf67419c9cf9 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.776540 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e892-8f38-403b-9908-cf67419c9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.776805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e892-8f38-403b-9908-cf67419c9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.802800 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-c7c9e892-8f38-403b-9908-cf67419c9cf9 None None] MFA Rules not processed for user `4c22549f7c90414db53901edd7b55c69`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:47.803995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c7c9e892-8f38-403b-9908-cf67419c9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:47.870720 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1339/2659] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:47.875350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.937123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc4064-49d5-4b2e-93e4-71d14eef7ffa admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:47.941857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:47.942526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:47.942813 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:47.943094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:47.943824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:47.946202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:47.950476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:47.974121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1321/2660] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:47.978127 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9e892-8f38-403b-9908-cf67419c9cf9 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:47.988588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9e892-8f38-403b-9908-cf67419c9cf9 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:48.046505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:48.047458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:48.047869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:48.048186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:48.049108 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:48.051568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:48.060428 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:48.074458 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1340/2661] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:47 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:48.078318 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:48.091028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abd004-97e1-4852-b817-c7b6427f8121 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:48.095780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:48.096486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:48.096775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:48.097057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:48.097792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:48.099427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:48.110338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1322/2662] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:52:48.114520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:48.125473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d5902-e204-4f2c-88e8-78f73706ef63 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:48.130091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:48.130973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:48.131287 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:48.131568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] PATH_INFO: `/v3/projects/d99900280142400b9e8ed541d9e43ba5/users/b8329f3ebda548f5a06e6bf5dc32b1fc/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:48.146473 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99900280142400b9e8ed541d9e43ba5, user_id=b8329f3ebda548f5a06e6bf5dc32b1fc, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:48.149393 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:48.163824 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1341/2663] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:48 2022] PUT /identity/v3/projects/d99900280142400b9e8ed541d9e43ba5/users/b8329f3ebda548f5a06e6bf5dc32b1fc/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:48.167807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:48.178042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243c65-d9de-497e-a4e6-aa2d80db41c4 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:48.235663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae44b1-28b6-48a6-be3b-90837f62ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:48.236365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae44b1-28b6-48a6-be3b-90837f62ab49 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:48.236654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae44b1-28b6-48a6-be3b-90837f62ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:48.236933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae44b1-28b6-48a6-be3b-90837f62ab49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:48.237658 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae44b1-28b6-48a6-be3b-90837f62ab49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:48.239277 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae44b1-28b6-48a6-be3b-90837f62ab49 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:48.249832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1323/2664] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:48.254588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:48.265657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa1c5-2100-4943-8c20-3cb427fe3c89 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:48.270267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:48.271162 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:48.271460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:48.271737 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] PATH_INFO: `/v3/projects/d99900280142400b9e8ed541d9e43ba5/users/b8329f3ebda548f5a06e6bf5dc32b1fc/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:48.273760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99900280142400b9e8ed541d9e43ba5, user_id=b8329f3ebda548f5a06e6bf5dc32b1fc, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:48.276630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:48.287909 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1342/2665] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:48 2022] PUT /identity/v3/projects/d99900280142400b9e8ed541d9e43ba5/users/b8329f3ebda548f5a06e6bf5dc32b1fc/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:48.297953 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd90d0-4fb6-4df7-9927-524657070721 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:48.298396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd90d0-4fb6-4df7-9927-524657070721 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:48.298701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd90d0-4fb6-4df7-9927-524657070721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:48.325394 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-88dd90d0-4fb6-4df7-9927-524657070721 None None] MFA Rules not processed for user `b8329f3ebda548f5a06e6bf5dc32b1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:48.326646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-88dd90d0-4fb6-4df7-9927-524657070721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:48.394944 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1324/2666] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:48.407784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:48.409680 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:48.466314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b37a6-84ba-4695-ac9e-9b7cb67fa01d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:48.470085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:48.470733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:48.471020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:48.471333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:48.481786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:48.483295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:48.494368 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1343/2667] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:48.997098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd90d0-4fb6-4df7-9927-524657070721 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:49.007778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd90d0-4fb6-4df7-9927-524657070721 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:49.011583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:49.012248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:49.012532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:49.012809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:49.077200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:49.080181 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:49.082467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:49.091740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1325/2668] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:52:51.792534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:51.794359 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:51.924195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f352e49-8c85-46bc-a796-4cce03b1a5a4 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:51.932138 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93176-797f-427c-baea-731e71100949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:51.932940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93176-797f-427c-baea-731e71100949 service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:51.933356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93176-797f-427c-baea-731e71100949 service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:51.933708 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93176-797f-427c-baea-731e71100949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:51.936364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-92b93176-797f-427c-baea-731e71100949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:51.950704 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b93176-797f-427c-baea-731e71100949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:51.952688 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b93176-797f-427c-baea-731e71100949 service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:51.967472 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1344/2669] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:53.243695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:53.254377 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844113e-368b-4c9c-b20f-2af691726101 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:53.256993 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80e557-1ce5-4ead-9dfd-9b15497717d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:53.257703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e557-1ce5-4ead-9dfd-9b15497717d8 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:53.257995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e557-1ce5-4ead-9dfd-9b15497717d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:53.258276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e557-1ce5-4ead-9dfd-9b15497717d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:53.324099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80e557-1ce5-4ead-9dfd-9b15497717d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:53.325848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80e557-1ce5-4ead-9dfd-9b15497717d8 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:53.343339 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1326/2670] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:55.419916 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93176-797f-427c-baea-731e71100949 service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:55.476088 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:55.499257 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93176-797f-427c-baea-731e71100949 service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:55.503787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:55.504658 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:55.505067 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:55.505211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] PATH_INFO: `/v3/users/95fe69087608430e8bb7af4d74cbeed0` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:55.506475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fe69087608430e8bb7af4d74cbeed0)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:55.508918 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:55.556703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fe69087608430e8bb7af4d74cbeed0'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:55.568589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fe69087608430e8bb7af4d74cbeed0'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:55.569288 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fe69087608430e8bb7af4d74cbeed0'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:55.576940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fe69087608430e8bb7af4d74cbeed0'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:55.588578 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fe69087608430e8bb7af4d74cbeed0'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:55.594876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1345/2671] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:55 2022] DELETE /identity/v3/users/95fe69087608430e8bb7af4d74cbeed0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:55.599654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:55.600122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:55.600218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:55.617236 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:55.618316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:55.677782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1327/2672] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:55.687991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:55.689557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:55.747934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5f8b4-1b42-4840-ba70-47741c5bf5b2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:55.751535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:55.752180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:55.752463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:55.752741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:55.763015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:55.764687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:55.775745 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1346/2673] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:55.868094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:55.869450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:55.889698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ddc23-5a34-43cd-9a61-4eef415967ef None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:55.893612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:55.894312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:55.894668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:55.895018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:55.896930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:55.909668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:55.911086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:55.920904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1328/2674] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:56.069965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:56.072040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:56.089933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec91e-1552-4a9e-a3cc-c1722b5422ca service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:56.099376 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:56.100403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:56.100664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:56.100957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] PATH_INFO: `/v3/projects/4ffb69db1159406faba3228d56a1f3b5` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:56.102159 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffb69db1159406faba3228d56a1f3b5)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:56.104124 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:56.159987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffb69db1159406faba3228d56a1f3b5', 'request_id': 'req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.165729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffb69db1159406faba3228d56a1f3b5', 'request_id': 'req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.167414 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:56.174975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffb69db1159406faba3228d56a1f3b5', 'request_id': 'req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.191657 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] The token cache is being invalidate because project 4ffb69db1159406faba3228d56a1f3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:56.191949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.192607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.194767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1347/2675] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:56 2022] DELETE /identity/v3/projects/4ffb69db1159406faba3228d56a1f3b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:56.198716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:56.208252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4202d-a20d-4e9c-a0fd-a1ed1bd6f443 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:56.269367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:56.270245 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:56.270674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:56.270962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] PATH_INFO: `/v3/users/4c22549f7c90414db53901edd7b55c69` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:56.272188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c22549f7c90414db53901edd7b55c69)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:56.275074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:56.297691 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:56.326165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c22549f7c90414db53901edd7b55c69'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.340255 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c22549f7c90414db53901edd7b55c69'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.349341 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c22549f7c90414db53901edd7b55c69'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.357013 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c22549f7c90414db53901edd7b55c69'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.357682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c22549f7c90414db53901edd7b55c69'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:56.364942 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1329/2676] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:56 2022] DELETE /identity/v3/users/4c22549f7c90414db53901edd7b55c69 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:56.842264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:56.843746 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:56.857553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a352b-7c42-4cb0-b44c-9ca704d8e385 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:56.934914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:56.935862 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:56.936263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:56.936556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] PATH_INFO: `/v3/projects/d28e4e02b9514340bf3848f03449214e` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:56.937773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28e4e02b9514340bf3848f03449214e)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:56.939762 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:57.004973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28e4e02b9514340bf3848f03449214e', 'request_id': 'req-b615f05d-2f7c-48da-8207-9fc87c42da5f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.012294 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28e4e02b9514340bf3848f03449214e', 'request_id': 'req-b615f05d-2f7c-48da-8207-9fc87c42da5f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.023848 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28e4e02b9514340bf3848f03449214e', 'request_id': 'req-b615f05d-2f7c-48da-8207-9fc87c42da5f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.042096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] The token cache is being invalidate because project d28e4e02b9514340bf3848f03449214e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:57.042477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.043378 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.045231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1348/2677] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:56 2022] DELETE /identity/v3/projects/d28e4e02b9514340bf3848f03449214e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:57.048951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:57.050730 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:57.065082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd576b5-92f5-409d-94f4-fb173bd5e22f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:57.135093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:57.136254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:57.136755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:57.137200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] PATH_INFO: `/v3/users/b8329f3ebda548f5a06e6bf5dc32b1fc` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:57.138684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8329f3ebda548f5a06e6bf5dc32b1fc)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:57.140779 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:57.202880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8329f3ebda548f5a06e6bf5dc32b1fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.215608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8329f3ebda548f5a06e6bf5dc32b1fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.223996 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8329f3ebda548f5a06e6bf5dc32b1fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.231409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8329f3ebda548f5a06e6bf5dc32b1fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.232122 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-74f8c664-c6ba-4bb5-8573-40a0a8729e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8329f3ebda548f5a06e6bf5dc32b1fc'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.238053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1330/2678] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:57 2022] DELETE /identity/v3/users/b8329f3ebda548f5a06e6bf5dc32b1fc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:57.559007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:57.561660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:57.591772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615f05d-2f7c-48da-8207-9fc87c42da5f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:57.658587 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:57.659622 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:57.660007 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:57.660387 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] PATH_INFO: `/v3/projects/d99900280142400b9e8ed541d9e43ba5` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:57.661666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99900280142400b9e8ed541d9e43ba5)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:57.664179 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:57.685828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:57.713856 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99900280142400b9e8ed541d9e43ba5', 'request_id': 'req-a281cd60-69d8-4b92-916c-16d6fe29fdf5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.719995 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99900280142400b9e8ed541d9e43ba5', 'request_id': 'req-a281cd60-69d8-4b92-916c-16d6fe29fdf5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.729809 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99900280142400b9e8ed541d9e43ba5', 'request_id': 'req-a281cd60-69d8-4b92-916c-16d6fe29fdf5'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.746686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] The token cache is being invalidate because project d99900280142400b9e8ed541d9e43ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:57.746985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.747678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-a281cd60-69d8-4b92-916c-16d6fe29fdf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:57.749518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1349/2679] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:57 2022] DELETE /identity/v3/projects/d99900280142400b9e8ed541d9e43ba5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:57.755248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e1ae2-0a90-4bc7-af9b-fe10cb4b8b66 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:57.755483 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e1ae2-0a90-4bc7-af9b-fe10cb4b8b66 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:57.755768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e1ae2-0a90-4bc7-af9b-fe10cb4b8b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:57.774836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-4d1e1ae2-0a90-4bc7-af9b-fe10cb4b8b66 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:57.776169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4d1e1ae2-0a90-4bc7-af9b-fe10cb4b8b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:57.790686 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:57.849228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1331/2680] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:57.858629 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93ba5e-06d7-4768-8dbd-73c3d8360f43 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:57.859239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93ba5e-06d7-4768-8dbd-73c3d8360f43 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:57.859519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93ba5e-06d7-4768-8dbd-73c3d8360f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:57.881783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4e93ba5e-06d7-4768-8dbd-73c3d8360f43 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:57.883181 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4e93ba5e-06d7-4768-8dbd-73c3d8360f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:57.895741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1350/2681] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:57.897164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e1ae2-0a90-4bc7-af9b-fe10cb4b8b66 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:57.908412 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e1ae2-0a90-4bc7-af9b-fe10cb4b8b66 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:57.914448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:57.915156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:57.915480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:57.915765 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:57.916809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:52:57.916809 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:57.918421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:57.934327 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1332/2682] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:52:57.935653 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93ba5e-06d7-4768-8dbd-73c3d8360f43 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:57.945663 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93ba5e-06d7-4768-8dbd-73c3d8360f43 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:57.950522 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:57.951347 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:57.951734 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:57.952110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:57.953004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:57.955001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:57.989015 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1351/2683] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:57 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:57.993807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.005735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf7b4-b705-4264-b7ee-d63e802d6a5b admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.070494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.071297 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.071583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.071856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.072715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.074799 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.098030 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1333/2684] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:57 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:58.102274 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.113027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caec61-a6b6-49ec-adb3-d96f94cce6b2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.118330 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.119026 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.119361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.119642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.120365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.121966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.135258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1352/2685] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:58.139548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.151010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16521146-06de-4264-99a9-bf3b9715b7de admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.155860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4ecee-a1fb-4e02-878c-771faa6fea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.156533 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4ecee-a1fb-4e02-878c-771faa6fea2d admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.156821 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4ecee-a1fb-4e02-878c-771faa6fea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.157099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4ecee-a1fb-4e02-878c-771faa6fea2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.157829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4ecee-a1fb-4e02-878c-771faa6fea2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.159644 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4ecee-a1fb-4e02-878c-771faa6fea2d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.178966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1334/2686] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:52:58.180144 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.199826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8518d9-3455-42d5-b43f-501472b99db2 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.209600 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.211790 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.216086 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.216086 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] PATH_INFO: `/v3/projects/9631aba1930e467aa8df0200b3e618bf/users/29fd28c108f3409e807db96dc89ea509/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.231926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9631aba1930e467aa8df0200b3e618bf, user_id=29fd28c108f3409e807db96dc89ea509, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.234691 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.248847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1353/2687] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:58 2022] PUT /identity/v3/projects/9631aba1930e467aa8df0200b3e618bf/users/29fd28c108f3409e807db96dc89ea509/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:58.262083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419006-1a7c-4b07-b7ca-c5bb62dc629d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.262677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419006-1a7c-4b07-b7ca-c5bb62dc629d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.262888 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419006-1a7c-4b07-b7ca-c5bb62dc629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.292241 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1f419006-1a7c-4b07-b7ca-c5bb62dc629d None None] MFA Rules not processed for user `29fd28c108f3409e807db96dc89ea509`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:58.293771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1f419006-1a7c-4b07-b7ca-c5bb62dc629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:58.386116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1335/2688] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:58.390693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.452364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ee2c8-0ed1-4b8f-878c-d4a93e15d3b8 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.457102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.457754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.458046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.458322 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.459004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.460992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.497930 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1354/2689] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:58 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:58.504144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419006-1a7c-4b07-b7ca-c5bb62dc629d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.518437 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419006-1a7c-4b07-b7ca-c5bb62dc629d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.530454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:58.578586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.579294 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.579589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.579873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.580694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.582625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.611444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1336/2690] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:58 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:58.612627 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.623926 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8b36-6c55-4808-908e-1d292a847bec admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.629646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.630318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.630611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.630896 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.631659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.633298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.647791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1355/2691] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:52:58.649664 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.663592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340d955-c063-48f4-accb-05a90166eb78 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.668569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5b04-2cc9-4f11-aba4-a024e566cf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.669260 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5b04-2cc9-4f11-aba4-a024e566cf43 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.669553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5b04-2cc9-4f11-aba4-a024e566cf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.669839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5b04-2cc9-4f11-aba4-a024e566cf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.670578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf5b04-2cc9-4f11-aba4-a024e566cf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.672911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf5b04-2cc9-4f11-aba4-a024e566cf43 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.683259 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1337/2692] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:58.687363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.697718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1048bd-c6ff-4328-b853-702c3609e14a admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:58.703120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:58.704057 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.704341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.704618 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] PATH_INFO: `/v3/projects/867858ca0db04e61948654c366b07015/users/4cf0b6ef1b8642d885318d57910d29ca/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.721371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=867858ca0db04e61948654c366b07015, user_id=4cf0b6ef1b8642d885318d57910d29ca, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:58.724291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:58.727290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:58.747990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1356/2693] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:58 2022] PUT /identity/v3/projects/867858ca0db04e61948654c366b07015/users/4cf0b6ef1b8642d885318d57910d29ca/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:58.757608 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8c0d1-c654-4402-b1f1-1b77ba3099d9 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:58.757995 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8c0d1-c654-4402-b1f1-1b77ba3099d9 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:58.758342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8c0d1-c654-4402-b1f1-1b77ba3099d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:58.800420 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-94f8c0d1-c654-4402-b1f1-1b77ba3099d9 None None] MFA Rules not processed for user `4cf0b6ef1b8642d885318d57910d29ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:58.801667 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-94f8c0d1-c654-4402-b1f1-1b77ba3099d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:58.903098 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:58.903934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1338/2694] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:58.995835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e2703-fc43-4be0-9528-0f38871b16aa admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.001178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.002060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.002193 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.002401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.003095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.005085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.046392 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1357/2695] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:52:58 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:59.048620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8c0d1-c654-4402-b1f1-1b77ba3099d9 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.060555 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8c0d1-c654-4402-b1f1-1b77ba3099d9 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.137187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.137764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.138118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.138494 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.139319 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.141476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.177067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1339/2696] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:52:59 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:52:59.178303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.200672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151003-c8ce-4980-af14-260437e85035 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.213474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.214301 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.214780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.215884 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.216725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.219267 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.243291 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1358/2697] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:52:59.244426 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.255826 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900856ef-213d-48c1-905e-09516be72686 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.262053 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.263063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.263816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.263816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] PATH_INFO: `/v3/projects/46ec9acfb6284bba9bb40a614e3e38df/users/550cf01dd2944e989701538de6ac1e90/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.276428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:59.281621 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ec9acfb6284bba9bb40a614e3e38df, user_id=550cf01dd2944e989701538de6ac1e90, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.289454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.306927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1340/2698] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:59 2022] PUT /identity/v3/projects/46ec9acfb6284bba9bb40a614e3e38df/users/550cf01dd2944e989701538de6ac1e90/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:59.310921 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.321272 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa534f48-2f6e-435f-b925-5badf1f4bd19 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.345717 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.347502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.396137 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.396853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.397643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.400607 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.402166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.403886 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.415093 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1359/2699] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:52:59.416111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.417815 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.431169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a303c-ed90-42aa-aea1-e59008744288 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.435897 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.436785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.437072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.437344 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] PATH_INFO: `/v3/users/409a723e3fe148e0aded87cbe5f5e254` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.438590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409a723e3fe148e0aded87cbe5f5e254)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.440060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cdfd4-58c6-420d-b36c-06f617a42b2a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.440528 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.445476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.446203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.446562 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.446928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.448865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.460983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.466189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.474083 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1341/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:52:59.476101 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.490518 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6e6d-aebb-4655-a25a-fa038a06b886 service placement] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.496351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a27d95-67da-4a8c-9aff-6d9ea46c75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.496983 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a27d95-67da-4a8c-9aff-6d9ea46c75ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.497271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a27d95-67da-4a8c-9aff-6d9ea46c75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.497548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a27d95-67da-4a8c-9aff-6d9ea46c75ec admin admin] PATH_INFO: `/v3/projects/46ec9acfb6284bba9bb40a614e3e38df/users/550cf01dd2944e989701538de6ac1e90/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.499526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a27d95-67da-4a8c-9aff-6d9ea46c75ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ec9acfb6284bba9bb40a614e3e38df, user_id=550cf01dd2944e989701538de6ac1e90, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.502276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a27d95-67da-4a8c-9aff-6d9ea46c75ec admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.514286 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1342/2701] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:52:59 2022] PUT /identity/v3/projects/46ec9acfb6284bba9bb40a614e3e38df/users/550cf01dd2944e989701538de6ac1e90/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:59.514968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409a723e3fe148e0aded87cbe5f5e254'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.525556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:59.531526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409a723e3fe148e0aded87cbe5f5e254'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.532362 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409a723e3fe148e0aded87cbe5f5e254'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.550863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409a723e3fe148e0aded87cbe5f5e254'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.560075 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409a723e3fe148e0aded87cbe5f5e254'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.567120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1360/2702] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:52:59 2022] DELETE /identity/v3/users/409a723e3fe148e0aded87cbe5f5e254 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:52:59.585303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.585870 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.586159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.614058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] MFA Rules not processed for user `550cf01dd2944e989701538de6ac1e90`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:59.615306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.703519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1343/2703] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:52:59.715079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.716581 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.756355 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.758003 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.795531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3894f2-8219-47c2-af1d-ce867e142e61 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.799890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.800550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.800835 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.801170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.812996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.814510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.818926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:52:59.825275 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1361/2704] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:52:59.835087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee0c7c-d7bf-4024-947b-405e8fb3c0a1 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.840118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.841396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.841772 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.842098 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] PATH_INFO: `/v3/projects/3a57b78704cb496a908316313d556e6b` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.843811 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a57b78704cb496a908316313d556e6b)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.846280 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.867258 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:52:59.868660 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.880325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a35b93-d369-4808-96d3-46591594435b service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:52:59.884158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67eeffd-0168-4692-99f1-ef4833640fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:52:59.884806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eeffd-0168-4692-99f1-ef4833640fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.885095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eeffd-0168-4692-99f1-ef4833640fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.885382 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67eeffd-0168-4692-99f1-ef4833640fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.887147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-c67eeffd-0168-4692-99f1-ef4833640fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.900622 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a57b78704cb496a908316313d556e6b', 'request_id': 'req-e50def82-b3f1-4c90-8452-53523cb43915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.907109 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a57b78704cb496a908316313d556e6b', 'request_id': 'req-e50def82-b3f1-4c90-8452-53523cb43915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.915737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a57b78704cb496a908316313d556e6b', 'request_id': 'req-e50def82-b3f1-4c90-8452-53523cb43915'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.926699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] The token cache is being invalidate because project 3a57b78704cb496a908316313d556e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:52:59.927046 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.927728 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-e50def82-b3f1-4c90-8452-53523cb43915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:52:59.930467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1344/2705] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:52:59 2022] DELETE /identity/v3/projects/3a57b78704cb496a908316313d556e6b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:52:59.935170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea5e6-e119-41a1-855d-a496616e41d8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:52:59.935486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea5e6-e119-41a1-855d-a496616e41d8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:52:59.935770 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea5e6-e119-41a1-855d-a496616e41d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:52:59.950353 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67eeffd-0168-4692-99f1-ef4833640fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:52:59.951847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67eeffd-0168-4692-99f1-ef4833640fe5 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:52:59.953364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-199ea5e6-e119-41a1-855d-a496616e41d8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:52:59.954548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-199ea5e6-e119-41a1-855d-a496616e41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:52:59.961063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1362/2706] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:52:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:53:00.015582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1345/2707] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:53:00.023186 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a31e43-d94c-4a97-8940-958eff430a59 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.023510 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a31e43-d94c-4a97-8940-958eff430a59 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.023796 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a31e43-d94c-4a97-8940-958eff430a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.041769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-74a31e43-d94c-4a97-8940-958eff430a59 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:00.042964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-74a31e43-d94c-4a97-8940-958eff430a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:00.050760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1363/2708] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:53:00.055047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea5e6-e119-41a1-855d-a496616e41d8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:00.064497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea5e6-e119-41a1-855d-a496616e41d8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:00.069054 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:00.069704 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.069987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.070264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.070982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:53:00.071321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:00.072918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:00.084175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1346/2709] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:53:00.088910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a31e43-d94c-4a97-8940-958eff430a59 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:00.100004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a31e43-d94c-4a97-8940-958eff430a59 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:00.104957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:00.105604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.105889 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.106169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.106892 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:00.108814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:00.139244 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1364/2710] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:53:00 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:53:00.142590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:00.153808 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151c28b-fa38-4717-bf10-849f076272c8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:00.221281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:00.221964 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.226192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.226192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.226192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:00.226192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:00.242835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:00.258308 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1347/2711] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:53:00 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:53:00.260443 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:00.273502 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ad23-cfb3-4a49-bb5f-5f1147c14c82 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:00.279299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:00.280021 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.280375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.280713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.281542 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:00.283298 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:00.296588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1365/2712] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:53:00.300926 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:00.318904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc850-7c56-48f2-a479-c17323c1be5a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:00.325819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a931f64-9246-45aa-85ea-6b59ca579c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:00.326785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a931f64-9246-45aa-85ea-6b59ca579c6b admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.327106 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a931f64-9246-45aa-85ea-6b59ca579c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.327550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a931f64-9246-45aa-85ea-6b59ca579c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.328454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a931f64-9246-45aa-85ea-6b59ca579c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:00.330725 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a931f64-9246-45aa-85ea-6b59ca579c6b admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:00.342675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1348/2713] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:53:00.347082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:00.358110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c89a6-227d-46ba-85e9-5abb6f693096 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:00.363005 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:00.363996 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.364351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.364702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] PATH_INFO: `/v3/projects/a4286a6f8aa74569b9e7169098092ce1/users/c760bdb803644351a90dd285ad4fe9ea/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.380280 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4286a6f8aa74569b9e7169098092ce1, user_id=c760bdb803644351a90dd285ad4fe9ea, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:00.383481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:00.396163 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1366/2714] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:53:00 2022] PUT /identity/v3/projects/a4286a6f8aa74569b9e7169098092ce1/users/c760bdb803644351a90dd285ad4fe9ea/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:00.402188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.402507 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.402788 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.420900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:00.422093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:00.478719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1349/2715] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:00.488417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:00.490147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:00.504794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:00.551956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8a74-122c-4064-b0c6-18ff3e70d383 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:00.555730 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93dfd3-5998-4669-9122-b4c2bcd3a07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:00.556544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93dfd3-5998-4669-9122-b4c2bcd3a07c service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:00.556777 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93dfd3-5998-4669-9122-b4c2bcd3a07c service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:00.557056 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93dfd3-5998-4669-9122-b4c2bcd3a07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:00.567402 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93dfd3-5998-4669-9122-b4c2bcd3a07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:00.569740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93dfd3-5998-4669-9122-b4c2bcd3a07c service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:00.578947 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1367/2716] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:02.940218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:02.941737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:02.953978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4151f-8dc8-4b29-b1bf-4551f907dc14 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:02.958755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:02.960231 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:02.960521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:02.960801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] PATH_INFO: `/v3/users/29fd28c108f3409e807db96dc89ea509` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:02.962058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fd28c108f3409e807db96dc89ea509)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:02.964018 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:03.016060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fd28c108f3409e807db96dc89ea509'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.029607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fd28c108f3409e807db96dc89ea509'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.037587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fd28c108f3409e807db96dc89ea509'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.047550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fd28c108f3409e807db96dc89ea509'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.048373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fd28c108f3409e807db96dc89ea509'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.055672 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1350/2717] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:53:02 2022] DELETE /identity/v3/users/29fd28c108f3409e807db96dc89ea509 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:03.061605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:03.062766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:03.063422 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:03.085601 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:03.087126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:03.167085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1368/2718] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:03.178078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:03.180163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:03.249313 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fcdee-ca5b-4f82-83eb-8cb756a39fa1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:03.253051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:03.253823 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:03.254174 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:03.254532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:03.265716 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:03.267296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:03.278613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1351/2719] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:53:03.790847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:03.798794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:03.846319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad55392-d138-4f57-b892-9202ffc31ebe None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:03.858898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:03.861059 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:03.863149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:03.863493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] PATH_INFO: `/v3/projects/9631aba1930e467aa8df0200b3e618bf` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:03.866927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9631aba1930e467aa8df0200b3e618bf)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:03.868958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:03.961448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9631aba1930e467aa8df0200b3e618bf', 'request_id': 'req-b48241ab-c6ea-4a36-8dee-3f5942ff8769'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.970363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9631aba1930e467aa8df0200b3e618bf', 'request_id': 'req-b48241ab-c6ea-4a36-8dee-3f5942ff8769'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.982043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9631aba1930e467aa8df0200b3e618bf', 'request_id': 'req-b48241ab-c6ea-4a36-8dee-3f5942ff8769'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.997559 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] The token cache is being invalidate because project 9631aba1930e467aa8df0200b3e618bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:53:03.998207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:03.999463 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b48241ab-c6ea-4a36-8dee-3f5942ff8769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:04.004847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1369/2720] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:53:03 2022] DELETE /identity/v3/projects/9631aba1930e467aa8df0200b3e618bf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:04.006147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:04.011389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:04.017409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161fd0-1d6d-4523-9de8-98b0314ee31f service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:04.101428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:04.102694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:04.102986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:04.103302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] PATH_INFO: `/v3/users/4cf0b6ef1b8642d885318d57910d29ca` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:04.104680 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf0b6ef1b8642d885318d57910d29ca)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:04.106676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:04.171252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf0b6ef1b8642d885318d57910d29ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:04.186824 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf0b6ef1b8642d885318d57910d29ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:04.196769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf0b6ef1b8642d885318d57910d29ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:04.212895 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf0b6ef1b8642d885318d57910d29ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:04.214478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf0b6ef1b8642d885318d57910d29ca'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:04.227291 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1352/2721] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:53:04 2022] DELETE /identity/v3/users/4cf0b6ef1b8642d885318d57910d29ca => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:05.029862 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:05.030395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:05.030573 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:05.038847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:05.040679 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:05.088535 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] MFA Rules not processed for user `c760bdb803644351a90dd285ad4fe9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:05.089755 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:05.124238 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:05.127598 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ab2c-9c92-459b-9b77-127e0473dc49 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:05.133064 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:05.133940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:05.134237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:05.134548 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] PATH_INFO: `/v3/projects/867858ca0db04e61948654c366b07015` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:05.135905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=867858ca0db04e61948654c366b07015)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:05.137961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:05.168866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1370/2722] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:05.174834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:05.184656 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:05.186973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:05.206985 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867858ca0db04e61948654c366b07015', 'request_id': 'req-b7a10af4-885e-46e3-91b5-355a72aaec15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.213934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867858ca0db04e61948654c366b07015', 'request_id': 'req-b7a10af4-885e-46e3-91b5-355a72aaec15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.223969 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867858ca0db04e61948654c366b07015', 'request_id': 'req-b7a10af4-885e-46e3-91b5-355a72aaec15'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.238573 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] The token cache is being invalidate because project 867858ca0db04e61948654c366b07015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:53:05.238948 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.239740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.241520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1353/2723] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:53:05 2022] DELETE /identity/v3/projects/867858ca0db04e61948654c366b07015 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:05.245429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:05.246783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:05.277444 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0faa8f-4c6e-4ac2-a9ef-0b3d730560b6 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:05.319846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a10af4-885e-46e3-91b5-355a72aaec15 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:05.326476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:05.327584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:05.327807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:05.328150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] PATH_INFO: `/v3/users/550cf01dd2944e989701538de6ac1e90` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:05.329431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=550cf01dd2944e989701538de6ac1e90)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:05.331708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:05.351949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37e7d70e2864edaa125e8f5ac1a3373', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:05.352620 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:05.352907 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:05.353191 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:05.355024 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:05.386505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550cf01dd2944e989701538de6ac1e90'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.401021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550cf01dd2944e989701538de6ac1e90'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.410977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550cf01dd2944e989701538de6ac1e90'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.419067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550cf01dd2944e989701538de6ac1e90'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.419840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550cf01dd2944e989701538de6ac1e90'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.420826 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:05.422605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:05.426370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1354/2724] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:53:05 2022] DELETE /identity/v3/users/550cf01dd2944e989701538de6ac1e90 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:53:05.433128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1371/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:53:05.801584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:05.803724 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:05.864626 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:05.910006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56aca7-15ca-45ea-b606-7d6b752c8978 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:05.917835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:05.918790 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:05.919102 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:05.919429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] PATH_INFO: `/v3/projects/46ec9acfb6284bba9bb40a614e3e38df` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:05.920766 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ec9acfb6284bba9bb40a614e3e38df)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:05.924549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:05.964008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:05.966082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:05.980135 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:05.987584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138acc58-69df-4fc8-8372-230cc32527fa service nova] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:05.990302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ec9acfb6284bba9bb40a614e3e38df', 'request_id': 'req-9b38278f-50b3-452b-98a4-f938c07ce59a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:05.999577 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ec9acfb6284bba9bb40a614e3e38df', 'request_id': 'req-9b38278f-50b3-452b-98a4-f938c07ce59a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.011037 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ec9acfb6284bba9bb40a614e3e38df', 'request_id': 'req-9b38278f-50b3-452b-98a4-f938c07ce59a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.028834 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] The token cache is being invalidate because project 46ec9acfb6284bba9bb40a614e3e38df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:53:06.029130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.029856 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b38278f-50b3-452b-98a4-f938c07ce59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.031619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1355/2726] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:53:05 2022] DELETE /identity/v3/projects/46ec9acfb6284bba9bb40a614e3e38df => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:06.037132 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39c25-04ab-488e-8928-b2f0bad63eaa None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.037421 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39c25-04ab-488e-8928-b2f0bad63eaa None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.038357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39c25-04ab-488e-8928-b2f0bad63eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.063585 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-ecf39c25-04ab-488e-8928-b2f0bad63eaa None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:06.064911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ecf39c25-04ab-488e-8928-b2f0bad63eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.068259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.069284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.069780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.070175 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] PATH_INFO: `/v3/users/f9f40c19e5b742ee8555147cf8ee6842` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.071919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f40c19e5b742ee8555147cf8ee6842)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.074060 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.080804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1356/2727] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:53:06.082273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64ed3-078e-4fec-a5b3-518258b0206a None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.082566 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64ed3-078e-4fec-a5b3-518258b0206a None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.082850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64ed3-078e-4fec-a5b3-518258b0206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.107036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-13f64ed3-078e-4fec-a5b3-518258b0206a None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:06.108336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-13f64ed3-078e-4fec-a5b3-518258b0206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.119146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1357/2728] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:06.123994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f64ed3-078e-4fec-a5b3-518258b0206a None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.133977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f64ed3-078e-4fec-a5b3-518258b0206a None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.137949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f40c19e5b742ee8555147cf8ee6842'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.140516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.141451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.141907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.142336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.143367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:53:06.143832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.145829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.155831 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f40c19e5b742ee8555147cf8ee6842'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.156674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f40c19e5b742ee8555147cf8ee6842'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.160051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1358/2729] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:53:06.165242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.167849 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f40c19e5b742ee8555147cf8ee6842'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.168159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.182515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-b8c4e94c-579a-4be9-a354-b6c25d3a7d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f40c19e5b742ee8555147cf8ee6842'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:06.186097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811acb4-2128-4b11-9eea-fc7313e2a3d2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.191287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.192095 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.192481 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.192859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.193656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.194806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1372/2730] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:53:05 2022] DELETE /identity/v3/users/f9f40c19e5b742ee8555147cf8ee6842 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:53:06.196358 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.196879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.196992 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.199171 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.219346 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:06.220823 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.244954 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1359/2731] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:53:06 2022] POST /identity/v3/projects => generated 359 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:53:06.246196 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.329499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1373/2732] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:06.332435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ca79-4644-4238-92d7-dd95b69b65a2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.339303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.340086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.340629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.340984 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.341784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.341918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.343072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.343992 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.374624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1360/2733] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:53:06 2022] POST /identity/v3/users => generated 280 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:53:06.378384 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.385780 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:06.390157 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:06.393499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655d37d-67ee-4b37-b31a-919480c68aa5 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.405493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.406365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.406758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.407490 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.409696 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.411472 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.422051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1361/2734] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:53:06.426612 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.438927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d0f55-43b5-4ac5-a39d-7e4d6a923600 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.441316 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9af3-d4bb-4495-8315-92b2c1f73597 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.446399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.447571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.448036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.448666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.449540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.451467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.464530 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1362/2735] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:53:06.468439 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.487917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5e70-3332-4c82-8f92-213301d46ffa admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.493729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.494911 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.495199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc545561-7ef9-4e5e-a58d-171e2b765e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.495371 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.495511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] PATH_INFO: `/v3/projects/a9bfe6c36c6c40dbb32134d681ef7436/users/e48427ec985f41d7a7db41947f51c50e/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.496134 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545561-7ef9-4e5e-a58d-171e2b765e2b service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.496633 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545561-7ef9-4e5e-a58d-171e2b765e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.496923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc545561-7ef9-4e5e-a58d-171e2b765e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.511456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc545561-7ef9-4e5e-a58d-171e2b765e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.513207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc545561-7ef9-4e5e-a58d-171e2b765e2b service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.514550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bfe6c36c6c40dbb32134d681ef7436, user_id=e48427ec985f41d7a7db41947f51c50e, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.517321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.526013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1374/2736] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:53:06.535364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1363/2737] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:53:06 2022] PUT /identity/v3/projects/a9bfe6c36c6c40dbb32134d681ef7436/users/e48427ec985f41d7a7db41947f51c50e/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:06.544726 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c4c-af56-4e91-b126-9d6027c88198 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.545029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c4c-af56-4e91-b126-9d6027c88198 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.545315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c4c-af56-4e91-b126-9d6027c88198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.577853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-4baf4c4c-af56-4e91-b126-9d6027c88198 None None] MFA Rules not processed for user `e48427ec985f41d7a7db41947f51c50e`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:06.579142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4baf4c4c-af56-4e91-b126-9d6027c88198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.664325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1375/2738] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:06.701910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.704444 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.780059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ce4dc-dfda-4af2-a9a5-47c9bd4b4335 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.784471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.785198 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.785553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.785900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.795980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.797505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.809642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1364/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:06 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:06.826043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c4c-af56-4e91-b126-9d6027c88198 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.865163 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:06.868980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:06.963164 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c4c-af56-4e91-b126-9d6027c88198 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.966317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614047e4-a893-42bb-9cae-cbea584bfae4 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:06.970621 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.971665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:06.971834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.972295 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.972501 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:06.972754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] PATH_INFO: `/v3/users/e48427ec985f41d7a7db41947f51c50e` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.972858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:06.973057 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] PATH_INFO: `/v3/projects/149f2dc3a1614cc1bbadefa440dac6a8` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:06.974282 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48427ec985f41d7a7db41947f51c50e)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.974455 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149f2dc3a1614cc1bbadefa440dac6a8)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:06.976569 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.977135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:06.995102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:07.035374 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149f2dc3a1614cc1bbadefa440dac6a8', 'request_id': 'req-7bd132bf-8060-4dc5-a819-d3977fba9e78'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.035780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48427ec985f41d7a7db41947f51c50e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.041957 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149f2dc3a1614cc1bbadefa440dac6a8', 'request_id': 'req-7bd132bf-8060-4dc5-a819-d3977fba9e78'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.048923 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48427ec985f41d7a7db41947f51c50e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.049702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48427ec985f41d7a7db41947f51c50e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.050391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149f2dc3a1614cc1bbadefa440dac6a8', 'request_id': 'req-7bd132bf-8060-4dc5-a819-d3977fba9e78'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.051857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:07.058832 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48427ec985f41d7a7db41947f51c50e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.064748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] The token cache is being invalidate because project 149f2dc3a1614cc1bbadefa440dac6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:53:07.065224 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.066042 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-36356b78-823a-4c3c-bdf8-0e2716b69679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48427ec985f41d7a7db41947f51c50e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.066220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-7bd132bf-8060-4dc5-a819-d3977fba9e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.067879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1365/2740] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:53:06 2022] DELETE /identity/v3/projects/149f2dc3a1614cc1bbadefa440dac6a8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:53:07.072606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:07.072903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:07.073191 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:07.074434 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1376/2741] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:53:06 2022] DELETE /identity/v3/users/e48427ec985f41d7a7db41947f51c50e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:53:07.088504 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:07.089113 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:07.089672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:07.094637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] MFA Rules not processed for user `c760bdb803644351a90dd285ad4fe9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:07.096324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:07.113470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:07.114818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:07.171460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1366/2742] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:07.188049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1377/2743] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:07.199563 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:07.201239 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:07.285646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98f9b2-9905-4c9a-8fca-1f4d5b7c92ac None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:07.289735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:07.290407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:07.290708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:07.290987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:07.301847 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:07.303886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:07.314185 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1367/2744] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:07.533198 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:07.534812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:07.558326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002173b5-fe8f-45c9-ac5e-d86078bba04c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:07.562914 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da271a-5022-44a1-bc8e-a513c1c85358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:07.563623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da271a-5022-44a1-bc8e-a513c1c85358 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:07.563910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da271a-5022-44a1-bc8e-a513c1c85358 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:07.564192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da271a-5022-44a1-bc8e-a513c1c85358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:07.566105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-42da271a-5022-44a1-bc8e-a513c1c85358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:07.583754 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da271a-5022-44a1-bc8e-a513c1c85358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:07.585818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da271a-5022-44a1-bc8e-a513c1c85358 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:07.610599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1378/2745] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:07.667474 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:07.668999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:07.694145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c3c2f-b11b-4bd8-8a4e-ffc4478741f9 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:07.704252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:07.705079 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:07.705453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:07.705654 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] PATH_INFO: `/v3/projects/a9bfe6c36c6c40dbb32134d681ef7436` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:07.708029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bfe6c36c6c40dbb32134d681ef7436)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:07.710590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:07.782596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bfe6c36c6c40dbb32134d681ef7436', 'request_id': 'req-b4311d69-0959-4efe-8e46-3bf70aed6504'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.789885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bfe6c36c6c40dbb32134d681ef7436', 'request_id': 'req-b4311d69-0959-4efe-8e46-3bf70aed6504'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.804596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bfe6c36c6c40dbb32134d681ef7436', 'request_id': 'req-b4311d69-0959-4efe-8e46-3bf70aed6504'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.819590 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] The token cache is being invalidate because project a9bfe6c36c6c40dbb32134d681ef7436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:53:07.820027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.820816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b4311d69-0959-4efe-8e46-3bf70aed6504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:07.822703 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1368/2746] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:53:07 2022] DELETE /identity/v3/projects/a9bfe6c36c6c40dbb32134d681ef7436 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:07.828229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44b13-2874-40a6-903a-0b6d4e8d5b31 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:07.828524 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44b13-2874-40a6-903a-0b6d4e8d5b31 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:07.828806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44b13-2874-40a6-903a-0b6d4e8d5b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:07.851496 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-9bf44b13-2874-40a6-903a-0b6d4e8d5b31 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:07.853008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9bf44b13-2874-40a6-903a-0b6d4e8d5b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:07.931968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1379/2747] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:07.941720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f87ee-f3ef-45f6-8b13-7b08eeabdcb8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:07.942184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f87ee-f3ef-45f6-8b13-7b08eeabdcb8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:07.942687 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f87ee-f3ef-45f6-8b13-7b08eeabdcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:07.989592 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-177f87ee-f3ef-45f6-8b13-7b08eeabdcb8 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:07.990497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-177f87ee-f3ef-45f6-8b13-7b08eeabdcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:08.016960 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1369/2748] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:08.020184 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf44b13-2874-40a6-903a-0b6d4e8d5b31 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:08.032533 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf44b13-2874-40a6-903a-0b6d4e8d5b31 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:08.039526 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:08.040250 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.040478 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.040958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.041851 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:53:08.042161 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:08.044241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:08.057944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1380/2749] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:53:08.066157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f87ee-f3ef-45f6-8b13-7b08eeabdcb8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:08.076262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f87ee-f3ef-45f6-8b13-7b08eeabdcb8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:08.081596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:08.082323 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.082700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.083700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.084645 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:08.086936 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:08.098121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:08.124891 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1370/2750] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:53:08 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:53:08.126112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:08.139228 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed942-e12d-430f-8985-0c164a7a3eec admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:08.151632 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:08.223875 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:08.225912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.226364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.226654 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.227439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:08.229418 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:08.261515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1381/2751] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:53:08 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:53:08.265358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:08.278511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cd864-8a89-401a-aef0-c2604f2f3c8c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:08.284633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:08.285764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.286058 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.286701 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.288147 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:08.290479 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:08.305685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1371/2752] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:53:08.310221 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:08.327904 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e8614-2e17-4100-b605-e1e882fbcfb0 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:08.334456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766f417-728e-4882-8562-d55aff4807a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:08.335955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f417-728e-4882-8562-d55aff4807a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.336302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f417-728e-4882-8562-d55aff4807a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.337126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f417-728e-4882-8562-d55aff4807a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.338046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766f417-728e-4882-8562-d55aff4807a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:08.339893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766f417-728e-4882-8562-d55aff4807a2 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:08.352802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1382/2753] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:53:08.356671 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:08.374272 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625da53-0092-4ff4-a6da-575293deb587 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:08.379468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:08.380962 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.381400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.382419 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] PATH_INFO: `/v3/projects/e7f8402a38284bb98c5f76dce0f11c81/users/f145a888da77497ea685fd6a1c438610/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.411646 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f8402a38284bb98c5f76dce0f11c81, user_id=f145a888da77497ea685fd6a1c438610, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:08.414684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:08.438907 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1372/2754] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:53:08 2022] PUT /identity/v3/projects/e7f8402a38284bb98c5f76dce0f11c81/users/f145a888da77497ea685fd6a1c438610/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:08.440812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519ed8-2e47-4650-93ae-d3fbafc732ec None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.441133 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519ed8-2e47-4650-93ae-d3fbafc732ec None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.441439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519ed8-2e47-4650-93ae-d3fbafc732ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.485915 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-e7519ed8-2e47-4650-93ae-d3fbafc732ec None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:08.492714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-e7519ed8-2e47-4650-93ae-d3fbafc732ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:08.641645 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1383/2755] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:08.652987 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:08.654934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:08.732151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01b671-2bb1-48c2-ab1d-8f3be90abbcd admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:08.736078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:08.736797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:08.737150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:08.737534 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:08.749393 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:08.751333 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:08.763975 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1373/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:13.650965 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001871ad-5b5f-4740-ab0b-949db8e03764 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:13.651558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001871ad-5b5f-4740-ab0b-949db8e03764 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:13.651558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001871ad-5b5f-4740-ab0b-949db8e03764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:13.684391 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-001871ad-5b5f-4740-ab0b-949db8e03764 None None] MFA Rules not processed for user `f145a888da77497ea685fd6a1c438610`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:13.685798 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-001871ad-5b5f-4740-ab0b-949db8e03764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:13.762619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1384/2757] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:13.767289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:13.779528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252ab76-a6f7-4407-b27b-e8994da616a6 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:13.788540 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:13.789398 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:13.789693 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:13.790059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:13.791410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:13.793238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:13.836219 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1374/2758] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:53:13 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:53:13.840302 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001871ad-5b5f-4740-ab0b-949db8e03764 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:13.856329 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001871ad-5b5f-4740-ab0b-949db8e03764 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:13.868859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:13.918278 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:13.918974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:13.919317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:13.919606 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:13.920436 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:13.922674 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:13.963389 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1385/2759] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:53:13 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:53:13.967497 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:13.978978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4e614-5520-45dd-a5b5-357f79f392f5 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:13.983791 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:13.984641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:13.985010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:13.985370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:13.986178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:13.987885 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:14.000065 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1375/2760] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:53:14.004667 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:14.014958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8833fb-68e4-4b4c-9778-4a28460b35dd admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:14.020343 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:14.021239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:14.021531 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:14.021839 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] PATH_INFO: `/v3/projects/ab7bbc3dc30f462db7e7caee45bf5fa3/users/e05d9e7f203b420b8dc0b62ce933a1a1/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:14.041426 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7bbc3dc30f462db7e7caee45bf5fa3, user_id=e05d9e7f203b420b8dc0b62ce933a1a1, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:14.044064 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:14.058709 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1386/2761] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:53:14 2022] PUT /identity/v3/projects/ab7bbc3dc30f462db7e7caee45bf5fa3/users/e05d9e7f203b420b8dc0b62ce933a1a1/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:14.062784 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:14.073321 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78ca65-3b56-4eda-8e14-1b40c6dbbbe8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:14.147400 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394288c4-1179-4a5a-9083-03e5b5cb8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:14.148971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394288c4-1179-4a5a-9083-03e5b5cb8618 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:14.149594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394288c4-1179-4a5a-9083-03e5b5cb8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:14.149952 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394288c4-1179-4a5a-9083-03e5b5cb8618 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:14.151124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394288c4-1179-4a5a-9083-03e5b5cb8618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:14.153116 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394288c4-1179-4a5a-9083-03e5b5cb8618 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:14.167074 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1376/2762] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:53:14.170747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:14.183342 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53b63-cd79-4ea0-838f-0451bc146d5e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:14.190588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:14.191613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:14.191900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:14.192178 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] PATH_INFO: `/v3/projects/ab7bbc3dc30f462db7e7caee45bf5fa3/users/e05d9e7f203b420b8dc0b62ce933a1a1/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:14.194245 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7bbc3dc30f462db7e7caee45bf5fa3, user_id=e05d9e7f203b420b8dc0b62ce933a1a1, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:14.196985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:14.208399 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1387/2763] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:53:14 2022] PUT /identity/v3/projects/ab7bbc3dc30f462db7e7caee45bf5fa3/users/e05d9e7f203b420b8dc0b62ce933a1a1/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:53:19.367982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435a3bf-ca82-4ce3-b747-7ff2c4e35832 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:19.368529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435a3bf-ca82-4ce3-b747-7ff2c4e35832 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:19.368715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435a3bf-ca82-4ce3-b747-7ff2c4e35832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:19.404268 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-6435a3bf-ca82-4ce3-b747-7ff2c4e35832 None None] MFA Rules not processed for user `e05d9e7f203b420b8dc0b62ce933a1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:19.406243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-6435a3bf-ca82-4ce3-b747-7ff2c4e35832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:19.432846 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:19.513814 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1377/2764] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:19.527662 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:19.530290 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:19.593566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffdb2f-22f8-440e-9707-00f3efac2d3e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:19.597166 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54dc244053a4253aa32f1eebd655589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:19.597825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:19.599271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:19.599271 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:19.681994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:19.683698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:19.700066 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1388/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:53:19.849504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c76450-e641-4da0-90dd-d809168b56a8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:19.850509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c76450-e641-4da0-90dd-d809168b56a8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:19.850901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c76450-e641-4da0-90dd-d809168b56a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:19.877103 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-91c76450-e641-4da0-90dd-d809168b56a8 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:19.879364 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-91c76450-e641-4da0-90dd-d809168b56a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:19.995760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1378/2766] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:53:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:20.014988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:20.018039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:20.065120 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:20.147579 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44ef4c-b0dc-4fe4-bfb7-1f7d22f66ef0 service glance] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:20.165523 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5841a8-a73b-4f91-b478-34e78f02cf99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:20.166199 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5841a8-a73b-4f91-b478-34e78f02cf99 service swift] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:20.166487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5841a8-a73b-4f91-b478-34e78f02cf99 service swift] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:20.166767 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5841a8-a73b-4f91-b478-34e78f02cf99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:20.189119 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5841a8-a73b-4f91-b478-34e78f02cf99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:20.190575 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5841a8-a73b-4f91-b478-34e78f02cf99 service swift] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:20.213243 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1389/2767] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:53:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:53:29.188643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03a35-c6ff-48a5-8c95-81a88739b451 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:29.189359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03a35-c6ff-48a5-8c95-81a88739b451 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:29.189359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03a35-c6ff-48a5-8c95-81a88739b451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:29.207930 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-eaf03a35-c6ff-48a5-8c95-81a88739b451 None None] MFA Rules not processed for user `f145a888da77497ea685fd6a1c438610`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:29.209877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-eaf03a35-c6ff-48a5-8c95-81a88739b451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:29.216816 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1379/2768] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:53:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:30.202142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=22 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:30.938898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762ac0-47eb-439b-bd22-cf863b94c546 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:30.939192 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762ac0-47eb-439b-bd22-cf863b94c546 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:30.939514 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762ac0-47eb-439b-bd22-cf863b94c546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:30.956812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-47762ac0-47eb-439b-bd22-cf863b94c546 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:53:30.958017 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-47762ac0-47eb-439b-bd22-cf863b94c546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:30.965687 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1390/2769] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 23 13:53:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:53:30.977941 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03a35-c6ff-48a5-8c95-81a88739b451 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:30.989720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03a35-c6ff-48a5-8c95-81a88739b451 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:30.994617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:30.995290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:30.995580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:30.995859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:31.003972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:31.005526 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:31.014014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1380/2770] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:53:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:53:40.952020 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:41.012558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=58 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:45.829213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47762ac0-47eb-439b-bd22-cf863b94c546 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:45.886589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47762ac0-47eb-439b-bd22-cf863b94c546 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:45.890563 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:45.891239 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:45.891529 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:45.891813 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:45.893604 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:45.960702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:45.962197 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:45.971963 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1391/2771] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:46.462642 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:46.467927 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:46.602072 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149b01-6f42-43b5-a3b0-2e0c4e4aba21 service swift] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:46.607520 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:46.608389 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:46.608845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:46.609276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:46.622217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:46.642170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:46.644094 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:46.658579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1381/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:53:50.052820 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:50.054299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:50.066281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83b4a8-97dc-40b4-a0d6-2ef80b224ae9 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:50.071365 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:50.072170 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:50.072590 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:50.072876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] PATH_INFO: `/v3/users/b88e9be988dd4d208aa83447c17fea13` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:50.074224 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88e9be988dd4d208aa83447c17fea13)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:50.076187 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:50.124043 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88e9be988dd4d208aa83447c17fea13'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.136785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88e9be988dd4d208aa83447c17fea13'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.138008 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88e9be988dd4d208aa83447c17fea13'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.144247 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88e9be988dd4d208aa83447c17fea13'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.151374 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88e9be988dd4d208aa83447c17fea13'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.157226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1392/2773] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:53:50 2022] DELETE /identity/v3/users/b88e9be988dd4d208aa83447c17fea13 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:50.329433 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:50.342197 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e227be-a7ef-4e6a-8bde-59256f17c781 service placement] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:50.401839 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:50.402797 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:50.403155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:50.403545 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] PATH_INFO: `/v3/projects/493cfa4c715c416eb76f94953f645f43` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:50.404804 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493cfa4c715c416eb76f94953f645f43)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:50.406783 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:50.455661 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493cfa4c715c416eb76f94953f645f43', 'request_id': 'req-3168def2-873b-4ced-953c-5e7082761c88'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.463134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493cfa4c715c416eb76f94953f645f43', 'request_id': 'req-3168def2-873b-4ced-953c-5e7082761c88'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.472584 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493cfa4c715c416eb76f94953f645f43', 'request_id': 'req-3168def2-873b-4ced-953c-5e7082761c88'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.484247 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] The token cache is being invalidate because project 493cfa4c715c416eb76f94953f645f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:53:50.484539 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.485220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.486774 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1382/2774] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:53:50 2022] DELETE /identity/v3/projects/493cfa4c715c416eb76f94953f645f43 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:50.491412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:50.492675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:50.505811 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d532bd7-71a0-4897-9ace-c4dc729bb77d admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:50.526148 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:50.571481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:50.572456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:50.572740 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:50.573045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] PATH_INFO: `/v3/users/dadf7e20f75145ad92e3410f5bc9c221` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:50.574211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadf7e20f75145ad92e3410f5bc9c221)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:50.576165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:50.627355 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadf7e20f75145ad92e3410f5bc9c221'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.641080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadf7e20f75145ad92e3410f5bc9c221'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.641080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadf7e20f75145ad92e3410f5bc9c221'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.649180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadf7e20f75145ad92e3410f5bc9c221'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.658864 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadf7e20f75145ad92e3410f5bc9c221'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.666345 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1393/2775] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:53:50 2022] DELETE /identity/v3/users/dadf7e20f75145ad92e3410f5bc9c221 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:50.845715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:50.847220 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:50.861582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168def2-873b-4ced-953c-5e7082761c88 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:50.881878 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:50.926008 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:50.926875 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:50.927262 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:50.927564 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] PATH_INFO: `/v3/projects/a4050011a7e741d3bf2f3e53e4f950f6` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:50.928762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4050011a7e741d3bf2f3e53e4f950f6)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:50.930698 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:50.977187 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4050011a7e741d3bf2f3e53e4f950f6', 'request_id': 'req-634b7754-ebc2-44af-b91c-23ea9076b440'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.983195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4050011a7e741d3bf2f3e53e4f950f6', 'request_id': 'req-634b7754-ebc2-44af-b91c-23ea9076b440'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:50.990519 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4050011a7e741d3bf2f3e53e4f950f6', 'request_id': 'req-634b7754-ebc2-44af-b91c-23ea9076b440'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:51.000632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] The token cache is being invalidate because project a4050011a7e741d3bf2f3e53e4f950f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:53:51.000923 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:51.001547 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:53:51.003069 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1383/2776] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:53:50 2022] DELETE /identity/v3/projects/a4050011a7e741d3bf2f3e53e4f950f6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:53:52.018183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:53:52.019710 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:52.075698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491302-7e30-42d9-a7e4-8c0b41fecc1f admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:53:52.122833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38d240-6b62-4b24-89b5-22b2b03767da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:53:52.123517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d240-6b62-4b24-89b5-22b2b03767da service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:53:52.123805 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d240-6b62-4b24-89b5-22b2b03767da service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:53:52.124087 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d240-6b62-4b24-89b5-22b2b03767da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:53:52.125847 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-4a38d240-6b62-4b24-89b5-22b2b03767da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:53:52.135655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:53:52.190447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38d240-6b62-4b24-89b5-22b2b03767da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:53:52.191956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38d240-6b62-4b24-89b5-22b2b03767da service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:53:52.202204 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1394/2777] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:54:00.997613 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:54:02.198004 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=24 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:54:36.536708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:54:36.538097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:54:36.605168 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b7754-ebc2-44af-b91c-23ea9076b440 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:54:36.610139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:54:36.610785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:54:36.611075 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:54:36.611386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:54:36.613175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:54:36.624939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:54:36.626502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:54:36.636233 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1384/2778] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:54:46.632014 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=32 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:13.459665 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51846136-6b13-41cc-9034-c42161173170 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:13.460149 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51846136-6b13-41cc-9034-c42161173170 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:13.460260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51846136-6b13-41cc-9034-c42161173170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:13.477744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-51846136-6b13-41cc-9034-c42161173170 None None] MFA Rules not processed for user `2fe7a2fd38f74ed6b5e2f3a1af29a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:13.478932 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-51846136-6b13-41cc-9034-c42161173170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:13.533203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1395/2779] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 23 13:55:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:13.573522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:13.574939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:13.642192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce57e9-235f-476a-a37e-6a1f41410d09 service placement] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:13.647591 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edc00ecebf0c451b94b56e3e97254010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:13.648263 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:13.648553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:13.648835 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:13.657089 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:13.658666 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:13.667143 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1385/2780] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 23 13:55:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:55:20.112112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51846136-6b13-41cc-9034-c42161173170 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:20.114132 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-51846136-6b13-41cc-9034-c42161173170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:20.182174 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51846136-6b13-41cc-9034-c42161173170 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:20.186611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:20.187512 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:20.187799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:20.188076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] PATH_INFO: `/v3/users/f145a888da77497ea685fd6a1c438610` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:20.189255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f145a888da77497ea685fd6a1c438610)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:20.191222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:20.237430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f145a888da77497ea685fd6a1c438610'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.249822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f145a888da77497ea685fd6a1c438610'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.250413 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f145a888da77497ea685fd6a1c438610'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.257079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f145a888da77497ea685fd6a1c438610'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.264033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f145a888da77497ea685fd6a1c438610'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.269999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1396/2781] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:20 2022] DELETE /identity/v3/users/f145a888da77497ea685fd6a1c438610 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:20.444040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:20.455001 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9052e2-5cd6-4deb-8ee5-577f306afeec service swift] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:20.514237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:20.515023 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:20.515347 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:20.515625 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] PATH_INFO: `/v3/projects/e7f8402a38284bb98c5f76dce0f11c81` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:20.516778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f8402a38284bb98c5f76dce0f11c81)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:20.518662 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:20.565121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f8402a38284bb98c5f76dce0f11c81', 'request_id': 'req-ec31f486-2b2e-4133-b486-ba4cd40728e6'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.570976 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f8402a38284bb98c5f76dce0f11c81', 'request_id': 'req-ec31f486-2b2e-4133-b486-ba4cd40728e6'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.578128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f8402a38284bb98c5f76dce0f11c81', 'request_id': 'req-ec31f486-2b2e-4133-b486-ba4cd40728e6'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.588702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] The token cache is being invalidate because project e7f8402a38284bb98c5f76dce0f11c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:20.588990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.589602 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.591097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1386/2782] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:20 2022] DELETE /identity/v3/projects/e7f8402a38284bb98c5f76dce0f11c81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:20.595022 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:20.596419 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:20.608994 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a30e2-dd31-4369-9b90-02d7178efb85 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:20.628442 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:20.667303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:20.668171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:20.668457 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:20.668738 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] PATH_INFO: `/v3/users/e05d9e7f203b420b8dc0b62ce933a1a1` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:20.669905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05d9e7f203b420b8dc0b62ce933a1a1)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:20.671852 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:20.714827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05d9e7f203b420b8dc0b62ce933a1a1'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.726861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05d9e7f203b420b8dc0b62ce933a1a1'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.727557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05d9e7f203b420b8dc0b62ce933a1a1'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.734456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05d9e7f203b420b8dc0b62ce933a1a1'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.741766 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-404c4955-4bca-44f6-aca8-9b3b9a16805e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05d9e7f203b420b8dc0b62ce933a1a1'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:20.747750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1397/2783] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:55:20 2022] DELETE /identity/v3/users/e05d9e7f203b420b8dc0b62ce933a1a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:20.922107 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:55:20.923607 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:20.938253 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31f486-2b2e-4133-b486-ba4cd40728e6 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:55:20.955581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:20.996735 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:55:20.997586 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:20.997868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:20.998142 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] PATH_INFO: `/v3/projects/ab7bbc3dc30f462db7e7caee45bf5fa3` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:20.999425 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7bbc3dc30f462db7e7caee45bf5fa3)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:55:21.001359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:55:21.046045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7bbc3dc30f462db7e7caee45bf5fa3', 'request_id': 'req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:21.052616 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7bbc3dc30f462db7e7caee45bf5fa3', 'request_id': 'req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:21.059886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7bbc3dc30f462db7e7caee45bf5fa3', 'request_id': 'req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:21.070055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] The token cache is being invalidate because project ab7bbc3dc30f462db7e7caee45bf5fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:55:21.070348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:21.070994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:55:21.072522 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1387/2784] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:55:20 2022] DELETE /identity/v3/projects/ab7bbc3dc30f462db7e7caee45bf5fa3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:55:30.744213 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:31.066981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:55:38.553859 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3278c76-434f-4abe-8c8f-ef77a497117a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:55:38.554400 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3278c76-434f-4abe-8c8f-ef77a497117a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:55:38.554499 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3278c76-434f-4abe-8c8f-ef77a497117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:55:38.571822 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d3278c76-434f-4abe-8c8f-ef77a497117a None None] MFA Rules not processed for user `c760bdb803644351a90dd285ad4fe9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:55:38.573036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d3278c76-434f-4abe-8c8f-ef77a497117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:55:38.626361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1398/2785] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:55:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:55:48.619971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=25 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:25.757290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:25.758676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:25.815589 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8952db-bc5e-450b-a4ce-8cd3cfcbe0a8 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:25.819115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:25.819789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:25.820078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:25.820359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:25.822120 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:25.889620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:25.891055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:25.902189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1388/2786] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:28.709969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3278c76-434f-4abe-8c8f-ef77a497117a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:28.719440 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3278c76-434f-4abe-8c8f-ef77a497117a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:28.722922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:28.723595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:28.723878 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:28.724150 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:28.725910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:28.740001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:28.741356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:28.752595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1399/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:35.897048 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=54 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:38.747196 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=6 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:45.102554 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.104059 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:45.169569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65009-ad18-48ab-8c0a-81eb3d99b73a service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.174638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.175599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.175884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.176162 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] PATH_INFO: `/v3/users/c760bdb803644351a90dd285ad4fe9ea` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.177326 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c760bdb803644351a90dd285ad4fe9ea)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.179303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.226477 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c760bdb803644351a90dd285ad4fe9ea'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.238511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c760bdb803644351a90dd285ad4fe9ea'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.245738 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c760bdb803644351a90dd285ad4fe9ea'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.253334 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c760bdb803644351a90dd285ad4fe9ea'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.253965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-ddb81890-8406-4dfa-bb56-ccb5139d9cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c760bdb803644351a90dd285ad4fe9ea'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.259752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1389/2788] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:56:45 2022] DELETE /identity/v3/users/c760bdb803644351a90dd285ad4fe9ea => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:45.428954 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.442123 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a022f8-1438-4158-ba45-bd54e901ab39 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.498350 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.499222 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.499518 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.499797 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] PATH_INFO: `/v3/projects/a4286a6f8aa74569b9e7169098092ce1` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.501019 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4286a6f8aa74569b9e7169098092ce1)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.503469 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.549371 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4286a6f8aa74569b9e7169098092ce1', 'request_id': 'req-ed9fe5df-6456-42ec-bb03-f1c6867b1315'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.554810 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4286a6f8aa74569b9e7169098092ce1', 'request_id': 'req-ed9fe5df-6456-42ec-bb03-f1c6867b1315'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.561869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4286a6f8aa74569b9e7169098092ce1', 'request_id': 'req-ed9fe5df-6456-42ec-bb03-f1c6867b1315'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.573437 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] The token cache is being invalidate because project a4286a6f8aa74569b9e7169098092ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:56:45.573727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.574363 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ed9fe5df-6456-42ec-bb03-f1c6867b1315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:56:45.575969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1400/2789] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:56:45 2022] DELETE /identity/v3/projects/a4286a6f8aa74569b9e7169098092ce1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:56:45.581363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916197-6a1c-4df0-828b-23dda5e77d3c None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.581652 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916197-6a1c-4df0-828b-23dda5e77d3c None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.581931 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916197-6a1c-4df0-828b-23dda5e77d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.598879 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2f916197-6a1c-4df0-828b-23dda5e77d3c None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:45.600099 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2f916197-6a1c-4df0-828b-23dda5e77d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:45.659264 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1390/2790] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:45.667116 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74471-6fcf-4f0d-9a1c-c281f4585787 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.667439 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74471-6fcf-4f0d-9a1c-c281f4585787 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.667723 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74471-6fcf-4f0d-9a1c-c281f4585787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.685586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-b5c74471-6fcf-4f0d-9a1c-c281f4585787 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:45.686782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-b5c74471-6fcf-4f0d-9a1c-c281f4585787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:45.698586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1401/2791] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:45.699714 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916197-6a1c-4df0-828b-23dda5e77d3c None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.710139 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916197-6a1c-4df0-828b-23dda5e77d3c None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.714946 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.715663 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.715955 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.716238 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.716980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:56:45.717296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.718910 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.734582 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1391/2792] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:56:45.735686 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74471-6fcf-4f0d-9a1c-c281f4585787 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.744783 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74471-6fcf-4f0d-9a1c-c281f4585787 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.749465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.749988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.750276 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.750554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.751349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.753781 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.780837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1402/2793] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:56:45 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:56:45.784884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.794583 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740528aa-c933-4373-af0a-126216236d99 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.798047 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:45.850785 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.851502 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.851787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.852073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.852748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.854655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.874202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1392/2794] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:56:45 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:56:45.878940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.889360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742af5d-0174-4e0d-a49f-f8cb8d74a7f0 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.894045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.894702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.894985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.895299 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.896018 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.897599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.908111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1403/2795] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:45.912123 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.922032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55313aed-ec10-4d7b-8d49-71436fbdb3be admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.927144 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c680e7-e007-4716-b97c-5d00b27ca721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.927836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c680e7-e007-4716-b97c-5d00b27ca721 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.928128 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c680e7-e007-4716-b97c-5d00b27ca721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.928414 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c680e7-e007-4716-b97c-5d00b27ca721 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.929252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c680e7-e007-4716-b97c-5d00b27ca721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.930958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c680e7-e007-4716-b97c-5d00b27ca721 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.941471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1393/2796] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:45.945597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:45.955612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d4dd-6dcc-412d-a2cf-8d26a71aa5cb admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:45.960079 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:45.960949 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:45.961232 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:45.961511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] PATH_INFO: `/v3/projects/6058256a4efd481280488c5a32ed1f39/users/ef6da718c9524338a46d024b72f2ab11/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:45.975544 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6058256a4efd481280488c5a32ed1f39, user_id=ef6da718c9524338a46d024b72f2ab11, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:45.978154 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:45.991545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1404/2797] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:45 2022] PUT /identity/v3/projects/6058256a4efd481280488c5a32ed1f39/users/ef6da718c9524338a46d024b72f2ab11/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:56:46.002973 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11123-a4c4-42bc-ad11-7630e69627d0 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.003306 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11123-a4c4-42bc-ad11-7630e69627d0 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.003597 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11123-a4c4-42bc-ad11-7630e69627d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.029281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-36b11123-a4c4-42bc-ad11-7630e69627d0 None None] MFA Rules not processed for user `ef6da718c9524338a46d024b72f2ab11`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:46.030524 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-36b11123-a4c4-42bc-ad11-7630e69627d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:46.092681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1394/2798] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:46.097147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.127546 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:46.161081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7176a-01f2-43eb-99e6-a30521aaca8c admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.165753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.166395 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.166678 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.166956 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.167672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.169566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.196262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1405/2799] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:56:46 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:46.198435 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11123-a4c4-42bc-ad11-7630e69627d0 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.208959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11123-a4c4-42bc-ad11-7630e69627d0 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.274317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.274994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.275578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.276043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.276755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.278676 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.300055 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1395/2800] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:56:46 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:56:46.303951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.314200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d22cb-0eef-4e3b-b7cf-e8503ce2b8ab admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.318784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.319490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.319774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.320055 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.320804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.322377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.332700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1406/2801] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:56:46.336510 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.342631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:46.347159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be4cc-df55-4e3f-81bf-77544ae2a664 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.352708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.353575 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.353858 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.354133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] PATH_INFO: `/v3/projects/00d24e7bdb7a473a9fc35f7e5968fc4d/users/5b24723de39648cb87e77d27d29d9232/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.368989 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d24e7bdb7a473a9fc35f7e5968fc4d, user_id=5b24723de39648cb87e77d27d29d9232, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.371700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.384505 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1396/2802] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:46 2022] PUT /identity/v3/projects/00d24e7bdb7a473a9fc35f7e5968fc4d/users/5b24723de39648cb87e77d27d29d9232/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:56:46.388861 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.398860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b1fe0-6e72-420d-9b70-9b1f3cbbaf56 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.453447 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0809-484c-4fab-8699-eee6ec3eee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.454103 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0809-484c-4fab-8699-eee6ec3eee88 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.454377 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0809-484c-4fab-8699-eee6ec3eee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.454703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0809-484c-4fab-8699-eee6ec3eee88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.455459 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0809-484c-4fab-8699-eee6ec3eee88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.457038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0809-484c-4fab-8699-eee6ec3eee88 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.466739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1407/2803] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:56:46.471033 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.481201 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaa437-2d2c-4946-80d8-34c169bde0f7 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.486257 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.486758 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.487040 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.487359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] PATH_INFO: `/v3/projects/00d24e7bdb7a473a9fc35f7e5968fc4d/users/5b24723de39648cb87e77d27d29d9232/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.489324 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d24e7bdb7a473a9fc35f7e5968fc4d, user_id=5b24723de39648cb87e77d27d29d9232, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.491978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.502511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1397/2804] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:56:46 2022] PUT /identity/v3/projects/00d24e7bdb7a473a9fc35f7e5968fc4d/users/5b24723de39648cb87e77d27d29d9232/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:56:46.512303 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9f55e-acbd-46ea-b76b-c6ee4a357950 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.512623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9f55e-acbd-46ea-b76b-c6ee4a357950 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.512906 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9f55e-acbd-46ea-b76b-c6ee4a357950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.542912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-2fe9f55e-acbd-46ea-b76b-c6ee4a357950 None None] MFA Rules not processed for user `5b24723de39648cb87e77d27d29d9232`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:56:46.544173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-2fe9f55e-acbd-46ea-b76b-c6ee4a357950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:46.611313 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1408/2805] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:56:46.622460 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.624175 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:56:46.679430 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd316b44-e4f5-46ca-b8bd-4fb8e6831665 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.683016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.683674 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.683963 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.684242 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.693188 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.694660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.704073 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1398/2806] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:46 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:46.772029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9f55e-acbd-46ea-b76b-c6ee4a357950 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:56:46.781866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9f55e-acbd-46ea-b76b-c6ee4a357950 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:56:46.786033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ba0c-fa2a-41b6-9cfa-85d55d9b5212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:56:46.786666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ba0c-fa2a-41b6-9cfa-85d55d9b5212 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:56:46.786950 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ba0c-fa2a-41b6-9cfa-85d55d9b5212 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:56:46.787246 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ba0c-fa2a-41b6-9cfa-85d55d9b5212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:56:46.806979 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:46.844032 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ba0c-fa2a-41b6-9cfa-85d55d9b5212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:56:46.846105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ba0c-fa2a-41b6-9cfa-85d55d9b5212 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:56:46.855114 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1409/2807] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:56:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:56:56.699933 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:56:56.850958 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=18 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:01.406133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:01.466212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec915b3-bd3b-4fe7-b33a-509e8c93f203 service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:01.471248 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:01.472119 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:01.472407 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:01.472688 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] PATH_INFO: `/v3/users/ef6da718c9524338a46d024b72f2ab11` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:01.473860 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6da718c9524338a46d024b72f2ab11)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:01.475832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:01.521484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6da718c9524338a46d024b72f2ab11'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:01.533751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6da718c9524338a46d024b72f2ab11'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:01.541159 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6da718c9524338a46d024b72f2ab11'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:01.548699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6da718c9524338a46d024b72f2ab11'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:01.549351 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6da718c9524338a46d024b72f2ab11'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:01.555110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1399/2808] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:01 2022] DELETE /identity/v3/users/ef6da718c9524338a46d024b72f2ab11 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:01.559700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:01.560171 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:01.560286 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:01.576743 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:01.577981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:01.635588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1410/2809] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:01.645845 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:01.647273 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:01.702934 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a17111-daa8-4409-8b26-c68841ba67d2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:01.706980 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:01.707643 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:01.707932 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:01.708211 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:01.716874 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:01.718295 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:01.727966 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1400/2810] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:01.987664 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:01.989348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:02.008136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399417e-5b0c-4a56-9f81-49218babd613 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:02.012975 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:02.013727 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:02.014063 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:02.014273 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] PATH_INFO: `/v3/projects/6058256a4efd481280488c5a32ed1f39` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:02.015487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6058256a4efd481280488c5a32ed1f39)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:02.018009 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:02.064819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6058256a4efd481280488c5a32ed1f39', 'request_id': 'req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.070361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6058256a4efd481280488c5a32ed1f39', 'request_id': 'req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.077511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6058256a4efd481280488c5a32ed1f39', 'request_id': 'req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.088700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] The token cache is being invalidate because project 6058256a4efd481280488c5a32ed1f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:02.088989 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.089615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.091126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1411/2811] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:01 2022] DELETE /identity/v3/projects/6058256a4efd481280488c5a32ed1f39 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:02.095135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:02.104651 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecea33-33a7-4320-8e04-590f57cd06a6 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:02.122007 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:02.162296 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:02.163256 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:02.163484 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:02.163764 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] PATH_INFO: `/v3/users/5b24723de39648cb87e77d27d29d9232` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:02.164939 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b24723de39648cb87e77d27d29d9232)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:02.166918 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:02.212670 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b24723de39648cb87e77d27d29d9232'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.224763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b24723de39648cb87e77d27d29d9232'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.232249 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b24723de39648cb87e77d27d29d9232'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.239638 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b24723de39648cb87e77d27d29d9232'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.240329 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-b3dc3375-b7f8-46d0-9773-9687e8167066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b24723de39648cb87e77d27d29d9232'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.246300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1401/2812] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:02 2022] DELETE /identity/v3/users/5b24723de39648cb87e77d27d29d9232 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:02.747396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:02.748860 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:02.761702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb39aff-cb38-4ff2-af74-cc6dc514ee29 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:02.817615 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:02.818474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:02.818759 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:02.819033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] PATH_INFO: `/v3/projects/00d24e7bdb7a473a9fc35f7e5968fc4d` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:02.820236 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d24e7bdb7a473a9fc35f7e5968fc4d)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:02.822129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:02.851525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:02.868870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d24e7bdb7a473a9fc35f7e5968fc4d', 'request_id': 'req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.874570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d24e7bdb7a473a9fc35f7e5968fc4d', 'request_id': 'req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.881211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d24e7bdb7a473a9fc35f7e5968fc4d', 'request_id': 'req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.892326 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] The token cache is being invalidate because project 00d24e7bdb7a473a9fc35f7e5968fc4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:02.892613 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.893235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-dea5d1cb-6aae-4e4d-92ba-10dc101a9402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:02.894799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1412/2813] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:02 2022] DELETE /identity/v3/projects/00d24e7bdb7a473a9fc35f7e5968fc4d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:02.899603 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870afe-3c2e-4a21-886e-adb1a5a8105d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:02.900084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870afe-3c2e-4a21-886e-adb1a5a8105d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:02.900240 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870afe-3c2e-4a21-886e-adb1a5a8105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:02.918516 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-73870afe-3c2e-4a21-886e-adb1a5a8105d None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:02.919739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-73870afe-3c2e-4a21-886e-adb1a5a8105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:02.982135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1402/2814] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:02.990876 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10f3b-ea00-464a-ab7d-5c348dbfed62 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:02.991110 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10f3b-ea00-464a-ab7d-5c348dbfed62 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:02.991424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a10f3b-ea00-464a-ab7d-5c348dbfed62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.009672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-63a10f3b-ea00-464a-ab7d-5c348dbfed62 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:03.010854 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-63a10f3b-ea00-464a-ab7d-5c348dbfed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:03.019153 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1413/2815] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:03.023060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870afe-3c2e-4a21-886e-adb1a5a8105d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.032750 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870afe-3c2e-4a21-886e-adb1a5a8105d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.037279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.037928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.038212 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.038491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.039228 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:57:03.039558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.041160 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.052842 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1403/2816] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:57:03.056769 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a10f3b-ea00-464a-ab7d-5c348dbfed62 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.066281 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a10f3b-ea00-464a-ab7d-5c348dbfed62 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.070818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.071490 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.071773 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.072047 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.072724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.074630 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.099552 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1414/2817] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:03 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:03.103487 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.113760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c78e8-a393-435e-a386-1f37bed4468e admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.138620 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:03.173668 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.174337 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.174632 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.174915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.175647 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.177569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.196556 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1404/2818] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:03 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:03.200652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.212136 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648202-25fb-484f-9a11-d1733b1e5d49 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.216863 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.217525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.217814 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.218096 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.218880 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.220611 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.231003 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1415/2819] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:03.235063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.253699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a7551-d62a-47f7-b3e2-ed09b5d443f2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.258440 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41da72-b309-4dad-a34c-6a2243ac584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.259133 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41da72-b309-4dad-a34c-6a2243ac584a admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.259467 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41da72-b309-4dad-a34c-6a2243ac584a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.259748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41da72-b309-4dad-a34c-6a2243ac584a admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.260473 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41da72-b309-4dad-a34c-6a2243ac584a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.262090 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41da72-b309-4dad-a34c-6a2243ac584a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.272110 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1405/2820] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:03.277034 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.287672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad1dbf-f28d-4211-80ad-5e05a32be066 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.292474 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.293352 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.293634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.293912 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] PATH_INFO: `/v3/projects/0b6a481a03964658abb8885134ac6af2/users/054087b8b97b416f8db23a697760129a/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.308736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6a481a03964658abb8885134ac6af2, user_id=054087b8b97b416f8db23a697760129a, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.311397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.324818 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1416/2821] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:03 2022] PUT /identity/v3/projects/0b6a481a03964658abb8885134ac6af2/users/054087b8b97b416f8db23a697760129a/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:03.335002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7a6d-80ae-4dbf-8a60-c7f120811d6f None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.335349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7a6d-80ae-4dbf-8a60-c7f120811d6f None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.335637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7a6d-80ae-4dbf-8a60-c7f120811d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.361706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-659a7a6d-80ae-4dbf-8a60-c7f120811d6f None None] MFA Rules not processed for user `054087b8b97b416f8db23a697760129a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:03.362892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-659a7a6d-80ae-4dbf-8a60-c7f120811d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:03.424464 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1406/2822] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:03.428786 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.489099 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306d9ff-3f6b-4040-80e9-2549dea8f48e admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.493661 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.494310 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.494597 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.494877 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.495605 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.497485 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.521991 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1417/2823] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:03 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:57:03.526165 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a7a6d-80ae-4dbf-8a60-c7f120811d6f None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.537017 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a7a6d-80ae-4dbf-8a60-c7f120811d6f None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.593778 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.594453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.594743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.595025 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.595767 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.597692 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.616904 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1407/2824] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:03 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:03.620857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.631408 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7d39-cd35-48ac-9013-4ff9b578d2e9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.635999 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.636652 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.636968 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.637251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.637974 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.639608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.652562 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1418/2825] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:03.656491 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.666427 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92507c-1cb7-4065-9be0-884ea8c82b60 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.671184 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.672081 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.672365 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.672637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] PATH_INFO: `/v3/projects/fd5f945490d146a6a95933359df8da62/users/215fbfb1e67d454ca806680e7f996349/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.686884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5f945490d146a6a95933359df8da62, user_id=215fbfb1e67d454ca806680e7f996349, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.690049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.705078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1408/2826] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:03 2022] PUT /identity/v3/projects/fd5f945490d146a6a95933359df8da62/users/215fbfb1e67d454ca806680e7f996349/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:03.708985 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.719045 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e670-491a-41de-b968-f333043db775 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.738460 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:03.780698 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec446f-0dde-4bf0-a3f9-3a85a76a91af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.781375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec446f-0dde-4bf0-a3f9-3a85a76a91af admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.781550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec446f-0dde-4bf0-a3f9-3a85a76a91af admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.781830 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec446f-0dde-4bf0-a3f9-3a85a76a91af admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.782558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec446f-0dde-4bf0-a3f9-3a85a76a91af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.784200 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec446f-0dde-4bf0-a3f9-3a85a76a91af admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.794212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1419/2827] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:57:03.798685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.804215 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:03.809897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a550f1-caa3-4608-9002-9ad7debee048 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:03.815852 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:03.816743 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.817031 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.817311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] PATH_INFO: `/v3/projects/fd5f945490d146a6a95933359df8da62/users/215fbfb1e67d454ca806680e7f996349/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.819285 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5f945490d146a6a95933359df8da62, user_id=215fbfb1e67d454ca806680e7f996349, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:03.821921 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:03.832049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1409/2828] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:03 2022] PUT /identity/v3/projects/fd5f945490d146a6a95933359df8da62/users/215fbfb1e67d454ca806680e7f996349/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:03.842040 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ea5d-881b-4cbb-95cc-b9fef2fe284c None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:03.842341 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ea5d-881b-4cbb-95cc-b9fef2fe284c None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:03.842628 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ea5d-881b-4cbb-95cc-b9fef2fe284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:03.870403 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-3381ea5d-881b-4cbb-95cc-b9fef2fe284c None None] MFA Rules not processed for user `215fbfb1e67d454ca806680e7f996349`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:03.871692 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-3381ea5d-881b-4cbb-95cc-b9fef2fe284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:03.938594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1420/2829] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:03.950338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:03.952062 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:04.012815 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ed05-1186-4019-9b5e-c1441c148f84 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:04.016378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:04.017016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:04.017302 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:04.017581 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:04.026553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:04.028002 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:04.037167 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1410/2830] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:04.108758 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ea5d-881b-4cbb-95cc-b9fef2fe284c None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:04.118681 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ea5d-881b-4cbb-95cc-b9fef2fe284c None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:04.122235 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a3ee-7a4a-4c6e-8729-1c143ff2bd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:04.122866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a3ee-7a4a-4c6e-8729-1c143ff2bd4a service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:04.123152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a3ee-7a4a-4c6e-8729-1c143ff2bd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:04.123465 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a3ee-7a4a-4c6e-8729-1c143ff2bd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:04.178787 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a3ee-7a4a-4c6e-8729-1c143ff2bd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:04.180252 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a3ee-7a4a-4c6e-8729-1c143ff2bd4a service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:04.189445 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1421/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:10.024136 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:10.085336 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d5978-88b9-4a9f-925b-5a39b95d08bc service cinder] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:10.089886 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:10.090752 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:10.091042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:10.091357 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] PATH_INFO: `/v3/users/054087b8b97b416f8db23a697760129a` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:10.092534 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=054087b8b97b416f8db23a697760129a)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:10.094450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:10.138713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054087b8b97b416f8db23a697760129a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.149986 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054087b8b97b416f8db23a697760129a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.156707 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054087b8b97b416f8db23a697760129a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.164151 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054087b8b97b416f8db23a697760129a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.164782 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054087b8b97b416f8db23a697760129a'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.170759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1411/2832] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:10 2022] DELETE /identity/v3/users/054087b8b97b416f8db23a697760129a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:10.175325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:10.175837 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:10.175944 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:10.192853 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:10.194049 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:10.232770 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=100 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:10.251672 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1422/2833] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:10.261740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:10.263155 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:10.276594 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:10.321876 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8ce8-85ca-4fe2-8c66-3f08a14fb271 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:10.325399 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:10.326036 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:10.326320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:10.326596 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:10.336146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:10.337578 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:10.348665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1412/2834] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:10.606033 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:10.607511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:10.621323 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94d1af-6223-4bc4-9b3d-0f3a56fd0d91 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:10.626081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:10.627046 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:10.627309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:10.627608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] PATH_INFO: `/v3/projects/0b6a481a03964658abb8885134ac6af2` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:10.628778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6a481a03964658abb8885134ac6af2)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:10.630739 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:10.677242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6a481a03964658abb8885134ac6af2', 'request_id': 'req-0799b50b-364d-4baa-b11f-9aad1b2f51ef'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.682643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6a481a03964658abb8885134ac6af2', 'request_id': 'req-0799b50b-364d-4baa-b11f-9aad1b2f51ef'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.689494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6a481a03964658abb8885134ac6af2', 'request_id': 'req-0799b50b-364d-4baa-b11f-9aad1b2f51ef'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.700259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] The token cache is being invalidate because project 0b6a481a03964658abb8885134ac6af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:10.700580 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.701216 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.702784 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1423/2835] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:10 2022] DELETE /identity/v3/projects/0b6a481a03964658abb8885134ac6af2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:10.707361 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:10.716928 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b80f0-e227-43c5-9766-7432b25b58e5 service neutron] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:10.772378 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:10.773281 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:10.773569 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:10.773851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] PATH_INFO: `/v3/users/215fbfb1e67d454ca806680e7f996349` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:10.775026 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215fbfb1e67d454ca806680e7f996349)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:10.777266 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:10.823997 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215fbfb1e67d454ca806680e7f996349'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.835699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215fbfb1e67d454ca806680e7f996349'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.843028 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215fbfb1e67d454ca806680e7f996349'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.849884 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215fbfb1e67d454ca806680e7f996349'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.850529 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-cb0b63f6-3e16-48da-b678-36dcc192e142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215fbfb1e67d454ca806680e7f996349'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:10.856396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1413/2836] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:10 2022] DELETE /identity/v3/users/215fbfb1e67d454ca806680e7f996349 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:11.127086 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.128572 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:11.142640 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b50b-364d-4baa-b11f-9aad1b2f51ef admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.199682 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.200543 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.200833 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.201115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] PATH_INFO: `/v3/projects/fd5f945490d146a6a95933359df8da62` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.202309 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5f945490d146a6a95933359df8da62)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.204254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.249260 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5f945490d146a6a95933359df8da62', 'request_id': 'req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:11.254890 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5f945490d146a6a95933359df8da62', 'request_id': 'req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:11.262231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5f945490d146a6a95933359df8da62', 'request_id': 'req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:11.269623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:11.274505 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] The token cache is being invalidate because project fd5f945490d146a6a95933359df8da62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86768) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:11.275085 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:11.276406 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-52cfa63f-7552-4491-87bf-c2ee0e02ccbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:11.278255 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1424/2837] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:11 2022] DELETE /identity/v3/projects/fd5f945490d146a6a95933359df8da62 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:11.283077 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc7f0-d3f6-449d-8e5b-b00f5ea383a6 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.284193 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc7f0-d3f6-449d-8e5b-b00f5ea383a6 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.284312 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc7f0-d3f6-449d-8e5b-b00f5ea383a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.301221 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-418fc7f0-d3f6-449d-8e5b-b00f5ea383a6 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:11.302415 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-418fc7f0-d3f6-449d-8e5b-b00f5ea383a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:11.331097 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:11.362657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1414/2838] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:11.370349 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bad8a-e148-410b-96e0-05e42c2087c2 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.370642 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bad8a-e148-410b-96e0-05e42c2087c2 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.370925 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bad8a-e148-410b-96e0-05e42c2087c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.388825 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-da2bad8a-e148-410b-96e0-05e42c2087c2 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:11.390001 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-da2bad8a-e148-410b-96e0-05e42c2087c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:11.398229 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1425/2839] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:11.402448 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fc7f0-d3f6-449d-8e5b-b00f5ea383a6 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.412509 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fc7f0-d3f6-449d-8e5b-b00f5ea383a6 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.417052 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.417719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.417990 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.418271 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] PATH_INFO: `/v3/domains` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.418994 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86769) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:57:11.419349 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.420951 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.432078 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1415/2840] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:57:11.436027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bad8a-e148-410b-96e0-05e42c2087c2 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.445036 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bad8a-e148-410b-96e0-05e42c2087c2 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.449675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.450320 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.450612 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.450898 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.451643 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.453534 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.479679 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1426/2841] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:11 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:11.483656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.493694 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8261fc-852b-46c3-9658-affff5a55828 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.549121 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.549715 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.550006 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.550287 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.550977 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.552922 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.572576 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1416/2842] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:11 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:57:11.576147 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.586747 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653567-4cf7-438e-9bd6-1ea9ddebfbd6 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.591375 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.592028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.592317 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.592599 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.593315 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.594934 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.605651 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1427/2843] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:11.609314 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.619178 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2533-f537-4d30-8b6a-b0c82cd04940 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.623753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338696d-3d2d-40e3-b50b-f8bbda6573f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.624397 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338696d-3d2d-40e3-b50b-f8bbda6573f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.624681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338696d-3d2d-40e3-b50b-f8bbda6573f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.624958 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338696d-3d2d-40e3-b50b-f8bbda6573f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.625675 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338696d-3d2d-40e3-b50b-f8bbda6573f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.627789 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338696d-3d2d-40e3-b50b-f8bbda6573f5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.637359 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1417/2844] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:11.641307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.651961 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace11c4-ea36-42d1-9765-96b4dd979ff0 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.656497 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.657361 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.657648 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.657928 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] PATH_INFO: `/v3/projects/d6cca8f0b31e4432bc6abac900d47835/users/1d6fcf92218645558c7671b3a366a52c/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.672223 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cca8f0b31e4432bc6abac900d47835, user_id=1d6fcf92218645558c7671b3a366a52c, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.674812 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.686744 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1428/2845] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:11 2022] PUT /identity/v3/projects/d6cca8f0b31e4432bc6abac900d47835/users/1d6fcf92218645558c7671b3a366a52c/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:11.697243 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d65e4-077a-463d-946d-6d51e2d7a4a8 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.697537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d65e4-077a-463d-946d-6d51e2d7a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.697817 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d65e4-077a-463d-946d-6d51e2d7a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.723695 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-f23d65e4-077a-463d-946d-6d51e2d7a4a8 None None] MFA Rules not processed for user `1d6fcf92218645558c7671b3a366a52c`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:11.724880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-f23d65e4-077a-463d-946d-6d51e2d7a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:11.787880 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1418/2846] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:11.792207 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.852901 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968cd5f-d310-4636-aa84-0f65da3e7fa9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.857477 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.858129 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.858417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.858700 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] PATH_INFO: `/v3/projects` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.859424 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.861312 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.886095 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1429/2847] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:11 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:11.890084 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d65e4-077a-463d-946d-6d51e2d7a4a8 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.901488 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d65e4-077a-463d-946d-6d51e2d7a4a8 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.926206 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:11.957706 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:11.958358 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:11.958641 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:11.958917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] PATH_INFO: `/v3/users` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:11.959633 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:11.961537 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:11.980848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1419/2848] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:11 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:11.984736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:11.994885 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da22285-5f8b-4261-8ca2-39045348a576 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:11.999576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:12.000292 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:12.000584 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:12.000866 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:12.001594 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:12.003714 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:12.020080 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1430/2849] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:12.024051 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:12.034299 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2483d-a2cf-4908-8ae3-a0995e14461d admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:12.038825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:12.039733 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:12.040021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:12.040300 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] PATH_INFO: `/v3/projects/55eed17d227f45ba8859f6aaa9d212d4/users/909ebfd3504148c29ed2bd8aa3fe5651/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:12.055544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55eed17d227f45ba8859f6aaa9d212d4, user_id=909ebfd3504148c29ed2bd8aa3fe5651, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:12.058153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:12.070768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1420/2850] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:12 2022] PUT /identity/v3/projects/55eed17d227f45ba8859f6aaa9d212d4/users/909ebfd3504148c29ed2bd8aa3fe5651/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:12.074557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:12.084724 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956bd6e-ad33-4368-8732-eb6517047f89 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:12.139634 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dcc34-ba92-4b4d-a733-4e7c8c246878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:12.140220 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dcc34-ba92-4b4d-a733-4e7c8c246878 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:12.140508 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dcc34-ba92-4b4d-a733-4e7c8c246878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:12.140782 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dcc34-ba92-4b4d-a733-4e7c8c246878 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:12.141491 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dcc34-ba92-4b4d-a733-4e7c8c246878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:12.143112 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dcc34-ba92-4b4d-a733-4e7c8c246878 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:12.152765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1431/2851] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:12.156971 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:12.167214 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5057-71b4-4cf8-84e1-b96d9b3690d2 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:12.171761 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:12.172631 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:12.172917 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:12.173192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] PATH_INFO: `/v3/projects/55eed17d227f45ba8859f6aaa9d212d4/users/909ebfd3504148c29ed2bd8aa3fe5651/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:12.175660 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55eed17d227f45ba8859f6aaa9d212d4, user_id=909ebfd3504148c29ed2bd8aa3fe5651, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:12.178269 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:12.188254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1421/2852] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:12 2022] PUT /identity/v3/projects/55eed17d227f45ba8859f6aaa9d212d4/users/909ebfd3504148c29ed2bd8aa3fe5651/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:12.199988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee86dbf-df1e-441f-bbb5-ca947e46d111 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:12.200501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee86dbf-df1e-441f-bbb5-ca947e46d111 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:12.200608 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee86dbf-df1e-441f-bbb5-ca947e46d111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:12.207158 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:12.226827 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-6ee86dbf-df1e-441f-bbb5-ca947e46d111 None None] MFA Rules not processed for user `909ebfd3504148c29ed2bd8aa3fe5651`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:12.228069 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-6ee86dbf-df1e-441f-bbb5-ca947e46d111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:12.295364 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1432/2853] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:12.306550 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:12.308348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:12.365380 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72be40-192a-4593-9ad0-d80ed3f79af3 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:12.369049 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629de74-486d-4fd6-98bd-5a602486ca2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:12.369690 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629de74-486d-4fd6-98bd-5a602486ca2f service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:12.369978 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629de74-486d-4fd6-98bd-5a602486ca2f service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:12.370258 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629de74-486d-4fd6-98bd-5a602486ca2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:12.380729 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629de74-486d-4fd6-98bd-5a602486ca2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:12.382157 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629de74-486d-4fd6-98bd-5a602486ca2f service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:12.391515 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1422/2854] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:13.653325 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee86dbf-df1e-441f-bbb5-ca947e46d111 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:13.713626 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee86dbf-df1e-441f-bbb5-ca947e46d111 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:13.717990 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:13.718870 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:13.719152 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:13.719456 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] PATH_INFO: `/v3/users/1d6fcf92218645558c7671b3a366a52c` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:13.720623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6fcf92218645558c7671b3a366a52c)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:13.722588 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:13.766217 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6fcf92218645558c7671b3a366a52c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:13.778037 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6fcf92218645558c7671b3a366a52c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:13.778685 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6fcf92218645558c7671b3a366a52c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:13.785013 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6fcf92218645558c7671b3a366a52c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:13.791964 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6fcf92218645558c7671b3a366a52c'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:13.797905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1433/2855] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:13 2022] DELETE /identity/v3/users/1d6fcf92218645558c7671b3a366a52c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:13.803063 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:13.803549 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:13.803665 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:13.821447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:13.822634 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:13.879829 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1423/2856] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:13.889516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:13.891027 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:13.902146 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:13.949429 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b74baf-f7bc-437c-a11e-2736e2c46fd6 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:13.953052 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:13.953693 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:13.953978 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:13.954259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:13.963072 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:13.964570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:13.974254 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1434/2857] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:57:14.248961 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:14.250749 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:14.264370 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd560cd-cc87-42d4-847c-6614e7b8ae06 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:14.269737 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:14.270713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:14.271067 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:14.271441 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] PATH_INFO: `/v3/projects/d6cca8f0b31e4432bc6abac900d47835` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:14.272719 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cca8f0b31e4432bc6abac900d47835)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:14.274748 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:14.298086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:14.327762 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cca8f0b31e4432bc6abac900d47835', 'request_id': 'req-335f1336-5c70-48e0-8f13-37d099c4f5ed'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.334486 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cca8f0b31e4432bc6abac900d47835', 'request_id': 'req-335f1336-5c70-48e0-8f13-37d099c4f5ed'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.342087 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cca8f0b31e4432bc6abac900d47835', 'request_id': 'req-335f1336-5c70-48e0-8f13-37d099c4f5ed'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.353915 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] The token cache is being invalidate because project d6cca8f0b31e4432bc6abac900d47835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:14.354204 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.354832 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.356381 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1424/2858] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:14 2022] DELETE /identity/v3/projects/d6cca8f0b31e4432bc6abac900d47835 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:14.360574 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:14.370118 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34d882-bd37-4818-b057-917cad248fe6 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:14.426115 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:14.426969 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:14.427284 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:14.427566 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] PATH_INFO: `/v3/users/909ebfd3504148c29ed2bd8aa3fe5651` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:14.428776 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909ebfd3504148c29ed2bd8aa3fe5651)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:14.430668 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:14.475966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909ebfd3504148c29ed2bd8aa3fe5651'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.488101 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909ebfd3504148c29ed2bd8aa3fe5651'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.488778 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909ebfd3504148c29ed2bd8aa3fe5651'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.495966 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909ebfd3504148c29ed2bd8aa3fe5651'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.502801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-c2bb4d2f-36bb-42a4-bcda-c749483eb885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909ebfd3504148c29ed2bd8aa3fe5651'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.508646 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1435/2859] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:14 2022] DELETE /identity/v3/users/909ebfd3504148c29ed2bd8aa3fe5651 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:14.777328 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:14.783060 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:14.796759 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f1336-5c70-48e0-8f13-37d099c4f5ed admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:14.855292 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:14.856156 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:14.856442 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:14.856721 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] PATH_INFO: `/v3/projects/55eed17d227f45ba8859f6aaa9d212d4` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:14.857889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55eed17d227f45ba8859f6aaa9d212d4)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:14.859857 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:14.906840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55eed17d227f45ba8859f6aaa9d212d4', 'request_id': 'req-51eb252a-d5e9-47fb-9156-3df15b18a842'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.912820 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55eed17d227f45ba8859f6aaa9d212d4', 'request_id': 'req-51eb252a-d5e9-47fb-9156-3df15b18a842'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.919740 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55eed17d227f45ba8859f6aaa9d212d4', 'request_id': 'req-51eb252a-d5e9-47fb-9156-3df15b18a842'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.929865 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] The token cache is being invalidate because project 55eed17d227f45ba8859f6aaa9d212d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:14.930153 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.930771 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-51eb252a-d5e9-47fb-9156-3df15b18a842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:14.932309 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1425/2860] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:14 2022] DELETE /identity/v3/projects/55eed17d227f45ba8859f6aaa9d212d4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:14.937262 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac5323-93aa-4a78-92fb-78a7f9e8f8b0 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:14.937715 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac5323-93aa-4a78-92fb-78a7f9e8f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:14.937857 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac5323-93aa-4a78-92fb-78a7f9e8f8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:14.956785 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-d8ac5323-93aa-4a78-92fb-78a7f9e8f8b0 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:14.957980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-d8ac5323-93aa-4a78-92fb-78a7f9e8f8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:14.982910 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:15.018556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1436/2861] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:15.026655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b19bf-a063-48e6-90eb-ca936c721194 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.026889 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b19bf-a063-48e6-90eb-ca936c721194 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.027172 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b19bf-a063-48e6-90eb-ca936c721194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.045010 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-925b19bf-a063-48e6-90eb-ca936c721194 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:15.046203 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-925b19bf-a063-48e6-90eb-ca936c721194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:15.054443 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1426/2862] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:15.058494 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac5323-93aa-4a78-92fb-78a7f9e8f8b0 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.068757 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac5323-93aa-4a78-92fb-78a7f9e8f8b0 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.073366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.074016 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.074307 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.074624 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.075396 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:57:15.075713 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.077300 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.088955 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1437/2863] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:57:15.093068 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b19bf-a063-48e6-90eb-ca936c721194 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.102150 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b19bf-a063-48e6-90eb-ca936c721194 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.106685 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.107367 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.107656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.107938 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.108630 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.110511 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.135822 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1427/2864] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:15 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:15.140105 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.151044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5557-456f-4381-ab52-9cdf1f9d4c72 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.204951 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.205610 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.206380 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.206655 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.207360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.209248 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.230919 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1438/2865] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:15 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:57:15.232700 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.242606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc791-a513-4701-b98f-51296b00568a admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.247149 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.247877 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.248169 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.248453 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.249201 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.250787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.252819 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:15.264818 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1428/2866] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:15.266089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.276900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003c252-1d0e-493a-a7c5-c2e4ed2eeb25 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.281475 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9517d5-8edd-4f88-8752-051e1d4fb023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.282126 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9517d5-8edd-4f88-8752-051e1d4fb023 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.282417 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9517d5-8edd-4f88-8752-051e1d4fb023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.282703 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9517d5-8edd-4f88-8752-051e1d4fb023 admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.283467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9517d5-8edd-4f88-8752-051e1d4fb023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.285927 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9517d5-8edd-4f88-8752-051e1d4fb023 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.297487 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1439/2867] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:15.301363 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.311311 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7423-c5d7-48fe-a507-8f26c3ddf278 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.315981 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.316905 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.317216 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.317496 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] PATH_INFO: `/v3/projects/4c0dcc3f8043416884cbc1ff5c9ea3a1/users/2d5426c016df47419653e76b4e04107f/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.332267 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0dcc3f8043416884cbc1ff5c9ea3a1, user_id=2d5426c016df47419653e76b4e04107f, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.334893 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.350827 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1429/2868] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:15 2022] PUT /identity/v3/projects/4c0dcc3f8043416884cbc1ff5c9ea3a1/users/2d5426c016df47419653e76b4e04107f/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:15.362936 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae818-7569-465d-9461-8da20eb13c02 None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.363266 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae818-7569-465d-9461-8da20eb13c02 None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.363556 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae818-7569-465d-9461-8da20eb13c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.389489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-a23ae818-7569-465d-9461-8da20eb13c02 None None] MFA Rules not processed for user `2d5426c016df47419653e76b4e04107f`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:15.390735 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-a23ae818-7569-465d-9461-8da20eb13c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:15.452516 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1440/2869] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:15.456863 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.517450 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519c8be-b524-4204-bf0d-435a2eaee3fb admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.522086 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.522739 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.523027 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.523342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.524035 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.526192 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.551913 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1430/2870] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:15 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:15.556240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ae818-7569-465d-9461-8da20eb13c02 None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.566725 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ae818-7569-465d-9461-8da20eb13c02 None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.589802 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:15.624308 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.624981 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.625270 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.625553 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.626240 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.628211 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.647107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1441/2871] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:15 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:15.651342 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.662775 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca6539-2505-4a56-abb1-01944b569ddf admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.667447 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.668104 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.668396 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.668682 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.669410 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.671016 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.682022 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1431/2872] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:15.686039 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.695736 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41115c17-67f7-4e9b-aab4-2a70efa04826 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.700340 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.701212 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.701501 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.701780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] PATH_INFO: `/v3/projects/a662d6d3628c4509a3be1f12435fb52f/users/85a89765713e4880b0482c3b5e1a044e/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.716638 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a662d6d3628c4509a3be1f12435fb52f, user_id=85a89765713e4880b0482c3b5e1a044e, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.719333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.733821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1442/2873] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:15 2022] PUT /identity/v3/projects/a662d6d3628c4509a3be1f12435fb52f/users/85a89765713e4880b0482c3b5e1a044e/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:15.738480 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.748338 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8d90-859a-4012-a451-0da2d24e3823 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.804528 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680094-6e4e-4084-ac9e-658d4748ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.805134 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680094-6e4e-4084-ac9e-658d4748ed00 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.805418 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680094-6e4e-4084-ac9e-658d4748ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.805702 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680094-6e4e-4084-ac9e-658d4748ed00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.806429 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32680094-6e4e-4084-ac9e-658d4748ed00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.808082 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32680094-6e4e-4084-ac9e-658d4748ed00 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.817681 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1432/2874] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:15.821702 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.832480 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf554-4f03-4fa7-a4a3-8d8b67d3a3fa admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:15.837081 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:15.837957 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.838241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.838517 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] PATH_INFO: `/v3/projects/a662d6d3628c4509a3be1f12435fb52f/users/85a89765713e4880b0482c3b5e1a044e/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.840484 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a662d6d3628c4509a3be1f12435fb52f, user_id=85a89765713e4880b0482c3b5e1a044e, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:15.843089 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:15.853819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1443/2875] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:15 2022] PUT /identity/v3/projects/a662d6d3628c4509a3be1f12435fb52f/users/85a89765713e4880b0482c3b5e1a044e/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:15.864897 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:15.865392 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:15.865504 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:15.891493 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] MFA Rules not processed for user `85a89765713e4880b0482c3b5e1a044e`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:15.892722 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:15.924768 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:15.960624 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1433/2876] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:15.972263 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:15.973988 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:16.029557 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203f23d-d1c3-4e5e-88cb-942a8f38b814 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:16.033102 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:16.033732 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:16.034054 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:16.034841 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:16.043623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:16.045028 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:16.054331 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1444/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:16.095747 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:16.097677 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:16.109288 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f008a-6b6d-43a3-9619-a01ba27ae4d4 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:16.112840 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f0f6-40e2-4849-939f-aa9dbd13ebc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:16.113478 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f0f6-40e2-4849-939f-aa9dbd13ebc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:16.113763 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f0f6-40e2-4849-939f-aa9dbd13ebc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:16.114039 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f0f6-40e2-4849-939f-aa9dbd13ebc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:16.169024 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3f0f6-40e2-4849-939f-aa9dbd13ebc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:16.170571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3f0f6-40e2-4849-939f-aa9dbd13ebc4 service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:16.179254 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1434/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:19.408144 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:19.469111 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26edd0-8d7f-416d-947a-2492452d6f44 service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:19.473586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:19.474449 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:19.474733 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:19.475011 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] PATH_INFO: `/v3/users/2d5426c016df47419653e76b4e04107f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:19.476218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5426c016df47419653e76b4e04107f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:19.478122 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:19.500941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:19.527924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5426c016df47419653e76b4e04107f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:19.539938 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5426c016df47419653e76b4e04107f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:19.540596 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5426c016df47419653e76b4e04107f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:19.547900 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5426c016df47419653e76b4e04107f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:19.555595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5426c016df47419653e76b4e04107f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:19.562241 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1445/2879] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:19 2022] DELETE /identity/v3/users/2d5426c016df47419653e76b4e04107f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:19.567158 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:19.567684 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:19.567792 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:19.584265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:19.585451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:19.641218 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1435/2880] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:19.650515 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:19.652251 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:19.708107 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728956-168e-4aad-9882-3d83209346fc admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:19.711729 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:19.712388 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:19.712659 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:19.712939 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:19.721675 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:19.723090 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:19.732319 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1446/2881] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:20.001534 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.002972 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:20.014769 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1603b8-c84b-4373-b07e-f2ff1ff17579 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:20.019454 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:20.020320 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.020606 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.020882 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] PATH_INFO: `/v3/projects/4c0dcc3f8043416884cbc1ff5c9ea3a1` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.022217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0dcc3f8043416884cbc1ff5c9ea3a1)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:20.024152 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:20.072210 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0dcc3f8043416884cbc1ff5c9ea3a1', 'request_id': 'req-9b961a32-1726-4786-863c-be7eba458c9c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.078391 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0dcc3f8043416884cbc1ff5c9ea3a1', 'request_id': 'req-9b961a32-1726-4786-863c-be7eba458c9c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.085629 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0dcc3f8043416884cbc1ff5c9ea3a1', 'request_id': 'req-9b961a32-1726-4786-863c-be7eba458c9c'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.087637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:20.098965 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] The token cache is being invalidate because project 4c0dcc3f8043416884cbc1ff5c9ea3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:20.099279 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.099903 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.101431 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1436/2882] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:20 2022] DELETE /identity/v3/projects/4c0dcc3f8043416884cbc1ff5c9ea3a1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:20.105586 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.115905 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d68ba-84ed-4e6c-b295-cb3fdb1d532c service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:20.172941 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:20.173821 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.174109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.174423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] PATH_INFO: `/v3/users/85a89765713e4880b0482c3b5e1a044e` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.176259 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a89765713e4880b0482c3b5e1a044e)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:20.178173 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:20.220231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:20.222538 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a89765713e4880b0482c3b5e1a044e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.236765 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a89765713e4880b0482c3b5e1a044e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.238038 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a89765713e4880b0482c3b5e1a044e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.246264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a89765713e4880b0482c3b5e1a044e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.253053 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-0c21b419-f74d-48c7-86f8-7cbae6284a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a89765713e4880b0482c3b5e1a044e'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.258987 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1447/2883] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:20 2022] DELETE /identity/v3/users/85a89765713e4880b0482c3b5e1a044e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:20.535760 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.537195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:20.550115 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961a32-1726-4786-863c-be7eba458c9c admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:20.611853 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:20.612655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.612940 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.613217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] PATH_INFO: `/v3/projects/a662d6d3628c4509a3be1f12435fb52f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.614387 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a662d6d3628c4509a3be1f12435fb52f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:20.616317 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:20.661521 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a662d6d3628c4509a3be1f12435fb52f', 'request_id': 'req-660a8205-13b7-4b5c-8b4f-734c17cf85c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.668075 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a662d6d3628c4509a3be1f12435fb52f', 'request_id': 'req-660a8205-13b7-4b5c-8b4f-734c17cf85c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.675417 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a662d6d3628c4509a3be1f12435fb52f', 'request_id': 'req-660a8205-13b7-4b5c-8b4f-734c17cf85c5'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.685755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] The token cache is being invalidate because project a662d6d3628c4509a3be1f12435fb52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:20.686043 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.686656 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-660a8205-13b7-4b5c-8b4f-734c17cf85c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:20.688202 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1437/2884] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:20 2022] DELETE /identity/v3/projects/a662d6d3628c4509a3be1f12435fb52f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:57:20.693481 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d88fd8-0eb8-4fad-b1c5-10c87d71211b None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.693940 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d88fd8-0eb8-4fad-b1c5-10c87d71211b None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.694076 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d88fd8-0eb8-4fad-b1c5-10c87d71211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.711750 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-01d88fd8-0eb8-4fad-b1c5-10c87d71211b None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:20.712924 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-01d88fd8-0eb8-4fad-b1c5-10c87d71211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:20.769451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1448/2885] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:20.777252 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926ba5-08ff-4fb7-9ac2-c4e7bd3f73b5 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.777544 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926ba5-08ff-4fb7-9ac2-c4e7bd3f73b5 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.777825 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926ba5-08ff-4fb7-9ac2-c4e7bd3f73b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.795451 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-d2926ba5-08ff-4fb7-9ac2-c4e7bd3f73b5 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:20.796635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-d2926ba5-08ff-4fb7-9ac2-c4e7bd3f73b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:20.804637 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1438/2886] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:57:20.808595 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d88fd8-0eb8-4fad-b1c5-10c87d71211b None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.818806 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d88fd8-0eb8-4fad-b1c5-10c87d71211b None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:20.823583 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:20.824269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.824558 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.824842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.825570 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86768) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:57:20.825883 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:20.827545 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:20.839554 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1449/2887] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 23 13:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:57:20.843742 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2926ba5-08ff-4fb7-9ac2-c4e7bd3f73b5 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.852873 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2926ba5-08ff-4fb7-9ac2-c4e7bd3f73b5 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:20.857535 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:20.858179 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.858468 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.858751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.859470 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:20.861383 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:20.886836 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1439/2888] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:20 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:20.890619 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.901381 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca88c8-1eca-48cb-88f3-b211d3ed0fe9 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:20.959448 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:20.960116 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:20.960430 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:20.960718 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:20.961405 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:20.963357 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:20.982690 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1450/2889] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:20 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:20.986807 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:20.997553 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705f58-0917-45ce-a0b0-08b0d1803d9f admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.002118 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.003424 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.003713 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.003988 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.004709 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.006303 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.016500 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1440/2890] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:21.020091 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.029973 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ffe33-34ef-40c5-8cdf-270796330dc6 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.034470 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed3186-ea91-491a-ab63-0de29c262efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.035318 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3186-ea91-491a-ab63-0de29c262efc admin admin] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.035592 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3186-ea91-491a-ab63-0de29c262efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.035869 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3186-ea91-491a-ab63-0de29c262efc admin admin] PATH_INFO: `/v3/roles` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.036585 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed3186-ea91-491a-ab63-0de29c262efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.038156 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed3186-ea91-491a-ab63-0de29c262efc admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.047819 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1451/2891] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:21.052124 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.061850 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb3cc3-7df9-4f44-9e3a-067cbce6e409 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.066999 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.067900 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.068189 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.068476 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] PATH_INFO: `/v3/projects/c3ecd566dc6e4191a072ceb789efea9d/users/5817b0e413544a13a6cae7b5ed6385df/roles/d38549e73a3b4007b78d77d91a93026f` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.084678 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ecd566dc6e4191a072ceb789efea9d, user_id=5817b0e413544a13a6cae7b5ed6385df, role_id=d38549e73a3b4007b78d77d91a93026f)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.087471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.100409 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1441/2892] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:21 2022] PUT /identity/v3/projects/c3ecd566dc6e4191a072ceb789efea9d/users/5817b0e413544a13a6cae7b5ed6385df/roles/d38549e73a3b4007b78d77d91a93026f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:21.111902 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab0175-20e6-4a5a-9705-dfbc31084a9a None None] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.112695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab0175-20e6-4a5a-9705-dfbc31084a9a None None] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.112980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab0175-20e6-4a5a-9705-dfbc31084a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.139550 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.auth.core [None req-44ab0175-20e6-4a5a-9705-dfbc31084a9a None None] MFA Rules not processed for user `5817b0e413544a13a6cae7b5ed6385df`. Rule list: `[]` (Enabled: `True`). {{(pid=86768) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:21.140666 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-44ab0175-20e6-4a5a-9705-dfbc31084a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:21.156791 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:21.211379 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1452/2893] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:21.216290 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.242350 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:21.287615 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940df3c-cf2c-4616-ae44-604c2c4198a1 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.292301 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.292959 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.293250 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.293532 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.294223 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.296170 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.321525 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1442/2894] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 23 13:57:21 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:21.325589 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab0175-20e6-4a5a-9705-dfbc31084a9a None None] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.336165 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab0175-20e6-4a5a-9705-dfbc31084a9a None None] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.392602 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.393231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] REQUEST_METHOD: `POST` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.393519 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.393804 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] PATH_INFO: `/v3/users` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.394489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.396431 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.416283 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1453/2895] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 23 13:57:21 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:57:21.420416 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.431373 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b2460-164f-4956-85b1-09209e7793d6 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.436029 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.436689 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.436982 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.437265 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.438021 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.439657 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.450135 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1443/2896] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:57:21.453952 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.464623 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377ef97-a097-42ea-9a7a-6ed1c6d73a2b admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.469356 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.470242 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.470525 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.470803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] PATH_INFO: `/v3/projects/309774a5d4f64a0f96cff3ce26e58bab/users/bf5ef312ae5f4da4803d632c42e7d64f/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.487741 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309774a5d4f64a0f96cff3ce26e58bab, user_id=bf5ef312ae5f4da4803d632c42e7d64f, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.490383 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.503551 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1454/2897] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:21 2022] PUT /identity/v3/projects/309774a5d4f64a0f96cff3ce26e58bab/users/bf5ef312ae5f4da4803d632c42e7d64f/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:21.507855 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.517708 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb0331-3cf7-46e2-aef7-779a436e9674 admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.573580 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ae630-5ff6-4e8b-b80b-25e03350c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.574289 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ae630-5ff6-4e8b-b80b-25e03350c078 admin admin] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.574571 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ae630-5ff6-4e8b-b80b-25e03350c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.574848 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ae630-5ff6-4e8b-b80b-25e03350c078 admin admin] PATH_INFO: `/v3/roles` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.575587 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ae630-5ff6-4e8b-b80b-25e03350c078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.577276 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ae630-5ff6-4e8b-b80b-25e03350c078 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.587699 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1444/2898] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 23 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:57:21.591828 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.602834 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b54010-a1fe-4946-9053-2744fb5d9a24 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.607591 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.608467 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] REQUEST_METHOD: `PUT` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.608753 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.609029 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] PATH_INFO: `/v3/projects/309774a5d4f64a0f96cff3ce26e58bab/users/bf5ef312ae5f4da4803d632c42e7d64f/roles/eb12d27128ad4920b71e88bc6a0a8257` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.610980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309774a5d4f64a0f96cff3ce26e58bab, user_id=bf5ef312ae5f4da4803d632c42e7d64f, role_id=eb12d27128ad4920b71e88bc6a0a8257)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.614226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.624348 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1455/2899] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 23 13:57:21 2022] PUT /identity/v3/projects/309774a5d4f64a0f96cff3ce26e58bab/users/bf5ef312ae5f4da4803d632c42e7d64f/roles/eb12d27128ad4920b71e88bc6a0a8257 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:57:21.689579 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e376d0-3efa-4b34-9102-f304fb419d1d None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.690195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e376d0-3efa-4b34-9102-f304fb419d1d None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.690195 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e376d0-3efa-4b34-9102-f304fb419d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.717909 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-04e376d0-3efa-4b34-9102-f304fb419d1d None None] MFA Rules not processed for user `bf5ef312ae5f4da4803d632c42e7d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:21.719112 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-04e376d0-3efa-4b34-9102-f304fb419d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:21.788100 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1445/2900] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:21.799466 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.801203 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:21.859893 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2653-dcdc-4954-88f0-bacc12eae003 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.863568 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.864226 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.864498 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.864780 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.873855 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:21.875333 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:21.885051 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1456/2901] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:21.953360 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e376d0-3efa-4b34-9102-f304fb419d1d None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:21.963635 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e376d0-3efa-4b34-9102-f304fb419d1d None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:21.967190 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148e24-d511-4467-a883-ae4986d93ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98ec37cbc1f4da88cc2d7887b26aa41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:21.967859 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148e24-d511-4467-a883-ae4986d93ffc service cinder] REQUEST_METHOD: `GET` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:21.968145 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148e24-d511-4467-a883-ae4986d93ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:21.968422 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148e24-d511-4467-a883-ae4986d93ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:21.978237 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:22.027471 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d148e24-d511-4467-a883-ae4986d93ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:22.028892 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d148e24-d511-4467-a883-ae4986d93ffc service cinder] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:22.039019 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1446/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:22.298109 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:22.313423 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:22.364401 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15ee34-ece2-45ed-940a-10b3be34058e service cinder] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:22.369082 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:22.369980 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:22.370264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:22.370539 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] PATH_INFO: `/v3/users/5817b0e413544a13a6cae7b5ed6385df` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:22.371803 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5817b0e413544a13a6cae7b5ed6385df)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:22.373696 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:22.417576 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5817b0e413544a13a6cae7b5ed6385df'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.429794 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5817b0e413544a13a6cae7b5ed6385df'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.430451 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5817b0e413544a13a6cae7b5ed6385df'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.437397 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5817b0e413544a13a6cae7b5ed6385df'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.444201 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5817b0e413544a13a6cae7b5ed6385df'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.449972 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1457/2903] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:22 2022] DELETE /identity/v3/users/5817b0e413544a13a6cae7b5ed6385df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:22.454434 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] REQUEST_METHOD: `POST` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:22.454753 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:22.455032 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:22.472801 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.auth.core [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] MFA Rules not processed for user `313ef37cfa214544815014c4f759284a`. Rule list: `[]` (Enabled: `True`). {{(pid=86769) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:57:22.474066 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:22.531787 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1447/2904] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 23 13:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:57:22.541842 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:22.543269 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:22.604183 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb6b3c-8120-49f5-98a2-3c626f8aae71 admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:22.608048 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45c718c1e1024d73b6b635f77bacdbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:22.608695 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:22.612264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:22.612264 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:22.618412 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:22.619879 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:22.630128 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1458/2905] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:57:22.887558 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:22.889130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:22.902851 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5ba7f-3a12-402f-a678-97be166d6fe4 None None] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:22.908146 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:22.909045 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:22.909332 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:22.909619 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] PATH_INFO: `/v3/projects/c3ecd566dc6e4191a072ceb789efea9d` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:22.910841 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ecd566dc6e4191a072ceb789efea9d)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:22.913093 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:22.962164 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ecd566dc6e4191a072ceb789efea9d', 'request_id': 'req-c57824a0-a70f-46da-aaca-c30da966a6ce'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.968428 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ecd566dc6e4191a072ceb789efea9d', 'request_id': 'req-c57824a0-a70f-46da-aaca-c30da966a6ce'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.975534 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ecd566dc6e4191a072ceb789efea9d', 'request_id': 'req-c57824a0-a70f-46da-aaca-c30da966a6ce'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.985751 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] The token cache is being invalidate because project c3ecd566dc6e4191a072ceb789efea9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:22.986042 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.986655 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:22.988200 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1448/2906] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:22 2022] DELETE /identity/v3/projects/c3ecd566dc6e4191a072ceb789efea9d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:22.992231 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:23.001774 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c57ec-100e-45b0-8f49-7cdf0411ac46 service neutron] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:23.034195 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:23.059366 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:23.060234 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:23.060520 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:23.060801 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] PATH_INFO: `/v3/users/bf5ef312ae5f4da4803d632c42e7d64f` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:23.061971 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5ef312ae5f4da4803d632c42e7d64f)` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:23.063933 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:23.109511 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5ef312ae5f4da4803d632c42e7d64f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.121493 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5ef312ae5f4da4803d632c42e7d64f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.122142 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5ef312ae5f4da4803d632c42e7d64f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.129500 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5ef312ae5f4da4803d632c42e7d64f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.136314 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.notifications [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5ef312ae5f4da4803d632c42e7d64f'} {{(pid=86768) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.142351 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1459/2907] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 23 13:57:22 2022] DELETE /identity/v3/users/bf5ef312ae5f4da4803d632c42e7d64f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:23.409868 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Authenticating user token {{(pid=86769) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:57:23.411369 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.fernet_utils [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86769) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:57:23.425348 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57824a0-a70f-46da-aaca-c30da966a6ce admin admin] Validating token access rules against request {{(pid=86769) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:57:23.457499 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:23.483755 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '313ef37cfa214544815014c4f759284a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4822884e35e54aa6816f97330f3285a9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86769) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:57:23.484617 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:57:23.484901 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:57:23.485177 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] PATH_INFO: `/v3/projects/309774a5d4f64a0f96cff3ce26e58bab` {{(pid=86769) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:57:23.486469 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309774a5d4f64a0f96cff3ce26e58bab)` {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:57:23.488331 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] RBAC: Authorization granted {{(pid=86769) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:57:23.532710 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309774a5d4f64a0f96cff3ce26e58bab', 'request_id': 'req-31048c75-8f6c-466b-9725-d2d898aeb557'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.539130 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309774a5d4f64a0f96cff3ce26e58bab', 'request_id': 'req-31048c75-8f6c-466b-9725-d2d898aeb557'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.546232 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309774a5d4f64a0f96cff3ce26e58bab', 'request_id': 'req-31048c75-8f6c-466b-9725-d2d898aeb557'} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.556315 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] The token cache is being invalidate because project 309774a5d4f64a0f96cff3ce26e58bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86769) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:57:23.556599 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.557217 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG keystone.notifications [None req-31048c75-8f6c-466b-9725-d2d898aeb557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86769) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:57:23.558720 dv-cinder-815582-10-smb devstack@keystone.service[86769]: [pid: 86769|app: 0|req: 1449/2908] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 23 13:57:23 2022] DELETE /identity/v3/projects/309774a5d4f64a0f96cff3ce26e58bab => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:57:33.138799 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:57:33.553386 dv-cinder-815582-10-smb devstack@keystone.service[86769]: DEBUG dbcounter [-] [86769] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:59:39.541044 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Authenticating user token {{(pid=86768) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:59:39.542489 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:59:39.681218 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b119e-3b87-4642-b36f-2eb975e619ea admin admin] Validating token access rules against request {{(pid=86768) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:59:39.737772 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c0d05-1a47-4c61-b12b-86f464d749ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5937de29a4c04fb9ab79f5ef77b24a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aae95f970644f279053e3f140353481', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86768) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:59:39.738360 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c0d05-1a47-4c61-b12b-86f464d749ff service placement] REQUEST_METHOD: `GET` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:59:39.738644 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c0d05-1a47-4c61-b12b-86f464d749ff service placement] SCRIPT_NAME: `/identity` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:59:39.738922 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c0d05-1a47-4c61-b12b-86f464d749ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86768) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:59:39.741249 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.fernet_utils [None req-329c0d05-1a47-4c61-b12b-86f464d749ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86768) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:59:39.752169 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c0d05-1a47-4c61-b12b-86f464d749ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:59:39.753760 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c0d05-1a47-4c61-b12b-86f464d749ff service placement] RBAC: Authorization granted {{(pid=86768) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:59:39.764180 dv-cinder-815582-10-smb devstack@keystone.service[86768]: [pid: 86768|app: 0|req: 1460/2909] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 23 13:59:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:59:49.760078 dv-cinder-815582-10-smb devstack@keystone.service[86768]: DEBUG dbcounter [-] [86768] Writing DB stats keystone:SELECT=89 {{(pid=86768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}